COE - Scrapper developers
IN
At Avolta (SIX: AVOL), our people are at the driving force behind our success. With a team of over 76,000 individuals representing more than 150 nationalities, we are a truly global company driven by passion, innovation, and excellence.
Born from the combination of Dufry and Autogrill, Avolta is redefining the travel experience through the dedication and expertise of our diverse workforce. Across 73 countries and 1,000 locations, our teams bring energy, creativity, and commitment to delivering world-class travel retail and food & beverage experiences.
We operate across multiple channels - including airports, motorways, cruise ships, ports, railways, and more - offering endless opportunities for collaboration and growth. Our people are empowered to make an impact, supported by a culture that values teamwork, development, and innovation.
Sustainability and social responsibility are embedded in our strategy, ensuring we grow in a way that benefits both our employees and the communities we serve.
Are you looking for a dynamic, international career where your contributions truly matter? Join Avolta and be part of a team that’s shaping the future of travel - together.
KEY RESPONSIBILITIES
Web Scraping & Competitor Onboarding - 65%
• Analyse assigned websites using Chrome DevTools (Network, Elements and Console) to determine whether data is
best extracted from HTML, XHR/Fetch requests, REST/JSON APIs, embedded JSON, or browser-rendered content.
• Develop production-grade spiders using the Scrapy framework, including Spiders, Requests/Responses, Items,
Item Loaders, Pipelines, Middlewares and project/settings configuration.
• Use Selenium WebDriver or Playwright for Python when required data cannot reliably be obtained through Scrapy
or direct HTTP requests.
• Handle JavaScript-rendered content and browser interactions such as dropdowns, pop-ups, location/airport
selection, load-more buttons and infinite scrolling.
• Implement and maintain location-specific crawls where product assortment, pricing, promotions, availability or
content varies by country, region, airport, store or selected location. Handle location selection through URLs, APIs,
cookies, sessions or browser interactions as required.
• Handle product variants accurately, including size, volume, pack size, colour or other product options, ensuring
relevant variants and their associated prices, availability, identifiers and attributes are extracted and mapped
correctly.
• Build robust XPath and CSS selectors capable of handling nested and changing HTML structures.
• Implement numbered, next-page, load-more, infinite-scroll and API/cursor-based pagination.
• Extract structured product information such as product name, brand, category, regular/promotional price, currency,
availability, product URL, image URL, SKU/product identifiers and other required attributes.
• Work with requests/httpx and direct APIs where browser automation is unnecessary; parse nested JSON and
embedded JavaScript/JSON objects.
• Implement request/session management including headers, cookies, retries, timeouts, redirects, throttling and proxy
configuration.
• Develop reusable scraping components and avoid duplicated website-specific logic wherever practical.
Data Quality, Testing & Validation - 20%
• Validate scraper output against the source website and defined data schema.
• Implement field validation, normalization and cleaning for prices, currencies, identifiers, availability and text fields.
• Handle missing fields, malformed responses, duplicate records and unexpected page structures gracefully.
Due to certain email system settings, some of our messages may occasionally land in your junk or spam folder. To ensure you don’t miss any important updates regarding your application, please check these folders regularly and mark our emails as ‘Not Spam’ if needed.
We look forward to connecting with you soon!