Job description
We are seeking a software engineer/developer or ETL/data integration/big data developer with experience in projects emphasizing data processing and storage.
This person will be responsible for supporting the data ingestion, transformation, and distribution to end consumers. The candidate will perform requirements analysis, design/develop process flow, unit and integration tests, and create/update process documentation.
The Opportunity:
- Work with the Business Intelligence team and operational stakeholders to design and implement both the data presentation layer available to the user community, as well as the underlying technical architecture of the data warehousing environment.
- Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes.
- Design and develop database objects, tables, stored procedures, views, etc.
- Independently analyze, solve, and correct issues in real time, providing problem resolution end-to-end.
- Design and develop ETL processes that will transform a variety of raw data, flat files, and Excel spreadsheets into SQL databases.
- Understand the concepts of Data marts and Data lakes and have experience with migrating legacy systems to data marts/lakes.
- Use additional cloud technologies (e.g., understand the concept of cloud services like Azure SQL Server).
- Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement.
- Strong interpersonal and communication skills to work in a team environment, including with customers, contractors, end users, and management team members.
- Manage multiple projects, responsibilities, and competing priorities.
Experience Needed:
- Programming languages, frameworks, and file formats such as Python, SQL, PLSQL, and VB.
- Database platforms such as Oracle, SQL Server, MySQL.
- Big data concepts and technologies such as Synapse and Databricks.