AWS Data Engineer
Data Engineer, Redshift, Snowflake, SQL, Python, PySpark
Description
GSPANN is hiring a skilled Data Engineer to design and maintain a robust data platform. You'll build scalable data pipelines, integrate multiple data sources, and collaborate with teams to deliver effective data solutions. Proficiency in SQL, Python, AWS data pipelines, and experience in the fintech industry is essential. If you're detail-oriented and enjoy simplifying tasks, this role is for you.
Who We Are
GSPANN has been in business for over a decade, with over 2000 employees worldwide, and servicing some of the largest retail, high technology, and manufacturing clients in North America. We provide an environment that enables career growth while still interacting with company leadership.
Visit Why GSPANN for more information.
Location: Hyderabad / Gurugram / Pune
Role Type: Full Time
Published On: 10 September 2024
Experience: 6+ Years
Description
GSPANN is hiring a skilled Data Engineer to design and maintain a robust data platform. You'll build scalable data pipelines, integrate multiple data sources, and collaborate with teams to deliver effective data solutions. Proficiency in SQL, Python, AWS data pipelines, and experience in the fintech industry is essential. If you're detail-oriented and enjoy simplifying tasks, this role is for you.
Role and Responsibilities
- Design, develop, and maintain a data platform that is accurate, secure, available, and fast.
- Engineer efficient, adaptable, and scalable data pipelines to process data.
- Integrate and maintain diverse data sources, including databases, APIs, SaaS, files, logs, and events.
- Create standardized datasets to support a wide variety of use cases.
- Develop subject-matter expertise in tables, systems, and processes.
- Partner with product and engineering to ensure product changes integrate well with the data platform.
- Partner with diverse stakeholder teams, understand their challenges and empower them with data solutions to meet their goals.
- Perform data quality checks and automate quality control processes.
Skills and Experience
- At least 5+ years of experience as a Data Engineer.
- Hands-on and in-depth experience with Star/Snowflake schema design, data modeling, data pipelining, and MLOps.
- Experience in Data Warehouse technologies (e.g. Snowflake, AWS Redshift, etc.).
- Experience in AWS data pipelines (Lambda, AWS glue, Step functions, etc.).
- Fintech or Financial services industry experience.
- Proficiency in SQL and at least one major programming language like Python or Java.
- Experience with Data Analysis Tools such as Looker or Tableau.
- Experience with Pandas, Numpy, Scikit-learn, and Jupyter notebooks preferred along with familiarity in Git, GitHub, and JIRA.
- Having an eye for detail to catch and resolve data quality issues.
- Look for opportunities to simplify, automate tasks, and build reusable components. You use good judgment when applying new technologies to solve business problems.
- End-to-end data platform support experience.
- Build strong relationships with analysts, business, and engineering stakeholders.
- You are independent. You can prioritize well, break down ambiguous problems into actionable tasks and, execute them.
- Familiar with agile methodologies.
- Experience in the fintech industry.
- Eager to stay updated or learn about the Private Equity/Venture Capital ecosystem and associated secondary market.
