Data Engineer
| Data Engineer | Réf : 2022-11-TNPIN-DS-DE

TNP India is searching for a data engineer with a lot of expertise to join our team. You’ll utilize a variety of techniques to turn raw data into useful data systems. you’ll be aiming for efficiency by matching data systems to business objectives. This position is open for our Kochi office.

JOB DESCRIPTION

Key responsibilities:

• Analyze and organize structured and unstructured data
• Create data pipelines and systems
• Examine the company’s requirements and goals
• Conduct in-depth data analysis and provide a report on the findings
• Make data ready for predictive and prescriptive modelling
• Create prototypes and algorithms
• Combine raw data from a variety of sources
• Look for ways to improve the quality and consistency of your data
• Identify data-gathering possibilities
• Create analytical software and tools
• Collaborate with data scientists and architects. Putting together massive, complicated data sets that satisfy both non-functional and functional business criteria
• Internal process enhancements, such as re-designing infrastructure for increased scalability, streamlining data transmission, and automating manual operations, were identified, designed, and implemented
• Using Cloud (Azure/AWS) and SQL technologies, create the infrastructure needed for optimum data extraction, transformation, and loading from diverse data sources
• Developing analytical tools to make use of the data pipeline, which will provide actionable insight into important business performance measures including operational efficiency and customer acquisition
• Assisting stakeholders, such as the data, design, product, and executive teams, with data-related technical difficulties

Minimum Qualifications:

• A graduate with an Engineering graduation/Master’s degree in technology
• At least 2-5years of relevant experience in Data Engineering
• Expertise in data models, data mining, and segmentation techniques
• Experience building and optimizing data pipelines, architectures, and data sets from sources such as SAP, Salesforce, other SQL and No SQL data base
• Advanced working SQL knowledge and working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
• Create ER diagrams and write relational database queries
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunitiesfor improvement
• Strong project management and organizational skills
• Experience supporting and working with cross-functional teams in a dynamic environment
• Good to have skills

Good to have skills:

• Azure Data Factory, Azure synopsis, Azure Storage/ Data Lake
• Setting up Microsoft SQL Server, and other SQL and No SQL data base
• Azure DevOps
• Working knowledge of message queuing, stream processing, and highly scalable data stores
• Knowledge in Big data Hadoop
• Programming language expertise (e.g., Java and Python)