fertcomputer.blogg.se - Airflow with python

#Airflow with python free#

#Airflow with python free#

Feel free to be an entrepreneur, an apprentice, a team player, and, of course, to be you. We offer a high-performing tech workplace where we treasure freedom, from how you find solutions to choosing your path. Although we look like a media group, we are really a tech company.

Hybrid working (office location in Amsterdam) Īt DPG Media, we work for more than 90 strong news brands, magazines, television shows, radio stations, and online services such as Qmusic, NU.nl, Tweakers, Libelle, and VTM.

Personal development opportunities such as education, training and certificates.

Participation in the profit sharing arrangement.

12% personal choice budget (of which 8% is holiday allowance).

Keeping up to date with the latest technologies through courses and conferences.

Mentoring junior engineers within the brands and your team.

Aligning the data engineering activities between DPG Media and DPG Online Services, which also means challenging existing solutions and working closely together with the data teams of DPG Media.

Designing, deploying, operating and refining the cloud-based data infrastructure for Online Services with a high degree of autonomy: your vision and input will shape the data products we deliver.Being an authoritative leader in data engineering within Online Services, where you join forces with specialists in data science, analytics and business intelligence, further strengthening and extending the data team.It’s your job to expand and leverage the current platform, collect additional requirements and see how existing cloud-based systems and pipelines can be optimally used to meet the needs of the Online Services brands. The technologies that we use: dbt, SQL, Spark, Airflow, Snowflake, Docker, Kubernetes, Python, Terraform & AWS, but we’re always evolving our tech stack. Data models for several machine learning projects, such as Job-2-Job recommendations, impression predictions, automated article labeling, job and vacancy classification, etc.

Enterprise data model in Snowflake for Sales Intelligence.ETL pipelines and data models in Snowflake powering management dashboards.Since the data platform is operational, it already supports numerous products and dashboards, including: The team’s goal is to enable the organization to become data-driven, hence supporting key strategic decisions. The Online Services Data Team, consisting of Data Engineers, Data Scientists and Dashboarding Specialists, spent the last three years building a state-of-the-art data and machine learning platform. Together with DPG Media, we are building one of the largest data ecosystems in the Netherlands and Belgium meanwhile looking after the business requirements specific to the brands of DPG Online Services. These service-focused platforms provide quality content and facilitate a large online community to help consumers decide on the best offer in tech, automotive, finance and recruitment. We service brands like Autotrack, Independer and Nationale Vacaturebank. This environment is the foundation of all data initiatives within DPG Online Services and enables dashboarding, advanced sales predictions, marketing automation and content recommendations & ranking amongst other cool applications.ĭPG Online Services, part of DPG Media, represents some of the most acclaimed supply-demand and community platforms in the Dutch and Belgian market.

Amsterdam – In your role as Data Engineer, you are responsible for building, extending, and supporting a robust and scalable big data environment which is already >7TB in size.