Data Engineer (Python, SQL, AWS or Azure)
Job Description
The Data Engineer performs moderate research, design, and data engineering assignments within a specific engineering functional area or product line in RX Global.
The successful candidate will create data architectures, such as databases and large-scale processing systems that are used by our business to monitor, understand, and gain data science-led insights into our global events.The Data Engineer works as part of a highly motivated, collaborative, enthusiastic, distributed, cross-functional team, using a modern tech stack and agile & develops principles to create data architectures that are of high quality and can be deployed to and used in production with confidence - safely and reliably.
Responsibilities:
- Design and develop data pipelines and ETL jobs on AWS Cloud (or Azure) platform based on functional/non-functional business requirements
- Design & implement Data Integration/Ingestion/Extraction solutions based on high level architecture design
- Identify, design, and implement process improvements & delivery optimizations
- Collaborate with Stakeholders and Reporting/Data Analysts to assist and translate business requirements to technical solutions
- Develop data lake solutions leveraging new or existing technology to advance the company's business
- Design, upgrade and implement new data workflows, automation, tools and API integrations
- Write and maintain technical documentation
- Perform unit tests and system integration tests
- Work with the team using Agile methodology
- Resolve basic technical issues as necessary
- Keep abreast of new technology developments
Qualifications:
- Bachelor's Degree (Engineering/Computer Science preferred but not required); or equivalent experience required.
- Experience dealing with various stakeholders in a global perspective
- 2-4 years experience as a Data Engineer (or related positions) with focus on data processing and/or relational databases
- Experienced with relational databases likeMS SQL Server
- Experienced in the following programming/scripting languages:SQL,Python.
- Experienced withAWS Cloud or Azure
- Experienced with working onStructured, Semi-Structured, Unstructured datasets
- Monitor, validate, and drive continuous improvement to methods, and propose enhancements to data sources that improve usability and results
- Proven stakeholder management
- Proven time and project management skills, experience in Agile Methodology is desired
- Good communication and presentation skills
- Analytical, structured, organized, and proactive
- Knowledge of software development methodologies (e.g.,Agile, Waterfall).
Non-negotiable requirements:
- MS SQL Server
- SQL
- Python
- AWS Cloud or Azure
- API Integration experience