Senior Data Engineer
- Design, develop, and maintain robust ETL/ELT pipelines to process and transform large datasets efficiently.
- Optimize data architecture and storage solutions to support analytics, machine learning, and business intelligence.
- Work with cloud platforms (AWS) to implement scalable data solutions.
- Ensure data quality, integrity, and security across all data pipelines.
- Collaborate with data scientists, analysts, and software engineers to support data-driven initiatives.
- Monitor and troubleshoot data workflows to ensure system performance and reliability.
- Create APIs to provide analytical information to our clients.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 5+ years of experience in data engineering or a related field.
- Strong proficiency in SQL and database technologies with (e.g., PostgreSQL, MySQL, Snowflake, BigQuery).
- Experience with data pipeline orchestration tools (e.g., Apache Airflow, Prefect, Dagster).
- Proficiency in programming languages such as Python and Scala.
- Hands-on experience with AWS cloud data services.
- Familiarity with big data processing frameworks like Apache Spark.
- Knowledge of data modeling, warehousing concepts, and distributed computing.
- Experience implementing CI/CD for data pipelines.
- Real-time data processing and streaming architectures (RisingWave, Kafka, Flink).
- Database performance tuning and query optimization.
- Strong problem-solving skills and the ability to work independently and collaboratively.
- ETL/ELT pipeline development and automation.
- Cloud computing and infrastructure management on AWS (nice to have).
- Direct Feedback and Rapid Growth: [96% of Topsorters report ]We work hard, set aggressive goals and execute flawlessly to accomplish them. We give candid feedback, push each other to set higher goals and produce more impact by always thinking "how do we do this faster and better".
- Be part of an elite and collaborative sports team: We believe startup scaleup is just like a team sport. It's been written in our motto since day 1 that we are collaborative internally, competitive externally, and never the other round around. You are ultimately surrounded by just different people that are all here to help you get the job done and shine as a team.
- Intellectual Rigor and Individuality : We were born in the pandemic by Stanford and Harvard alum cofounders who offer remote-working options with coworking memberships and (at least) once a year in person offsite gathering. You'll be welcomed by coworkers in 11 countries that all bring a unique perspective to the company from day 1. From personalized birthday gifts to work anniversaries, and management training program or in-person gatherings or career talks and mentorships, part-time DJs and tik-tok vloggers are also commercial leaders and technical staff at Topsort. We don't take management with a cookie cutter approach - but rather we cherish your quarks and think it makes us stronger.
- Company Offsite and Industry Exposure: Once a year Topsorters get together as a whole and also meet customers and really spend time to get feedback.
- Working Equipment and Hubs: our team is global and also centered around hubs, that means you're welcome to create a hybrid work schedule, and encouraged to travel to other hubs to collaborate. We provide working devices of your choice and surprise swags for special events.
- Flexible PTO schedule with floating holidays: we encourage Topsorters to take time off and recharge, and respect different cultural norms so offer floating holidays to accommodate the celebrations you'd like.
- Meditation App, Birthday and Anniversary Celebrations: we like little surprises and remember the key moments to celebrate with you!
Recommended Jobs
Financial Services Administrator
Financial Services Administrator Bristol 9 month FTC £Competitive + training + excellent benefits Looking to take your first step into the financial services sector? Or build on your ex…
Database Administrator
Transaction Services Senior Manager / Associate Director - Leeds (hybrid) Our client one of the worlds leading consultancy and advisory forms is very popular based on having an excellent client…
Energy Engineer
About The Company: OCS UK & Ireland is a leading facilities management company with 50,000+ colleagues and a turnover in excess of £2bn. We deliver innovative, award-winning services within facili…
Supply Chain & Operations Consultant (Planning)
Job Description Job Role: Strategy & Consulting - Supply Chain & Operations Consultant (Planning) Location: London Career Level: Consultant Company Background Accenture is a leading glo…
Care Assistant Twilight
We are now recruiting a dedicated and compassionate Care Assistant to join our friendly team on our Twilight Shift, supporting residents during the evening hours and helping to ensure their comfort a…
Corporate Tax Director
Job Details A leading professional services company is currently seeking a corporate Tax Director to join their expanding tax advisory team. This is a great opportunity to be in a high-impact lead…
Specialty Pricing Expert - Cyber
Job Details Are you a qualified (or part-qualified) GI actuary looking to develop your cyber pricing career within a major global reinsurer? Then look no further... This is an exceptional opp…
C++ Developer - FX eTrading
Job Description: We are seeking an experienced and skilled C++ Developer to join our team. The selected candidate will be responsible for delivering critical low-latency front-office pricing and tr…
VodafoneThree - Event Technical Authority
with our customers.What you'll doAs an Event Technical Lead, you'll be part of a dedicated rota of Technical Event Leads, providing round-the-clock support and stepping in to take charge when complex…
Registered Midwife - Whitechapel
Registered Midwife - Whitechapel Pulse are looking for registered highly motivated and talented Band 6 Midwife in London Borough of Tower Hamlets, East London. At Pulse, we understand that bein…