Senior Data Engineer

Role: Senior Data Engineer - (AWS, Opensearch)
Years of Experience: 5-8 Years
Location: Ahmedabad, Pune, Indore
Notice Period: Immediate to 45 Days Max
Job Description: We are seeking a highly motivated and enthusiastic Senior Data Engineer with 5- 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Data Engineering/Data analytics and a passion for leveraging data to drive business insights and innovation.
Qualifications:
Bachelor’s degree in Computer Science, Data Science, or a related field.
Required Skills and Qualifications:
5-8 years of experience in data engineering, with a proven track record of building and managing data solutions.
Design, develop, and manage scalable data solutions on AWS (RDS, DynamoDB, S3)
Build and optimize Logstash pipelines to push Kafka events into OpenSearch for real-time search and monitoring.
Work on OpenSearch indexing and query optimization to improve performance and scalability.
Collaborate with cross-functional teams to design and implement efficient ETL/ELT pipelines using Logstash, AWS Glue, Lambda, PySpark, and other tools.
Manage and optimize data warehouses such as DynamoDB and SQL
Ensure high availability, performance tuning, and reliability of relational and NoSQL databases.
Work with structured and unstructured data formats (JSON, CSV, XML, Excel).
Integrate data solutions with BI tools like PowerBI or any reporting.
Having Knowledge on LLM/NLP techniques, providing basic integration knowledge where applicable.
Collaborate using version control (GitHub, SVN), ticketing systems (Jira)
Excellent problem-solving, analytical, and communication skills.
Must Have
AWS
Amazon RDS
DynamoDB
Data warehouse
Logstash
Kafka
OpenSearch
Elasticsearch (alternative keyword to for OpenSearch)
Should Have
Power BI
LLM and NLP Awareness

Work arrangement
No