Required Skills
About the Job
Infinite Computer Solutions is seeking a talented Data Engineer to join our team in Goa. In this role, you will leverage your expertise in Spark SQL, PySpark-SQL, and Azure services to design, develop, and optimize data pipelines. You will be responsible for extracting, transforming, and aggregating data from various sources, analyzing customer usage patterns with Python, and building robust ETL processes using Azure Data Factory. Experience with Data Bricks for Spark application development and real-time optimization is crucial. You will also contribute to code reviews, implement metadata-driven ingestion frameworks, and utilize GitHub for version control. Generating reports and insights using Power BI is a key aspect of this position. Experience with Azure cloud architecture (ADLS, ADFS, ADF) and the USA Healthcare Insurance domain is a plus.
