Data Engineer 10yrs (Azure + Thoughtspot)

Azure Data Engineering & Analytics Consultant (Azure & ThoughtSpot)
Remote - Anywhere in India
Exp - 10+yrs
Full time permanent position with Vivid Edge Corp.
Azure+Thoughtspot 10 yrs Data Engineer
We are seeking a Data Engineering & Analytics Consultant to bridge the gap between our cloud data infrastructure and modern business intelligence. In this role, you will analyze our existing data footprints within Azure Synapse Analytics and Azure Data Lake Storage (ADLS) to design, build, and optimize the data pipelines required to power ThoughtSpot. You will work closely with a highly capable technical team to translate raw data assets into search-ready, high-performance data models.
Key Responsibilities :
Data Discovery & Analysis: Audit and analyze complex data structures, schemas, and files within Azure Data Lake and Azure Synapse to understand underlying business logic.
Pipeline Development: Design, build, and optimize robust ETL/ELT pipelines to transform raw data into clean, curated datasets.
ThoughtSpot Optimization: Model and structure data specifically tailored for ThoughtSpot’s search-driven architecture, ensuring fast query performance and intuitive user searching.
Performance Tuning: Optimize Synapse SQL pools (dedicated or serverless) and indexing strategies to handle high-concurrency analytical workloads.
Collaboration: Partner with internal data engineering teams, business analysts, and stakeholders to define data requirements and governance standards.
Required Technical Skills :
Cloud Data Platforms: Deep, hands-on experience with Azure Synapse Analytics (SQL pools, pipelines) and Azure Data Lake Storage (ADLS Gen2).
Data Modeling & Analytics: Strong expertise in relational and non-relational data modeling, including star/snowflake schemas and data warehousing concepts.
SQL & Programming: Advanced SQL skills for complex data analysis and manipulation. Proficiency in Python or PySpark for data engineering tasks.
BI Integration: Direct experience preparing data for modern BI tools, with specific experience or strong conceptual understanding of ThoughtSpot (e.g., configuring worksheets, answers, and pinboards).
Qualifications & Experience :
Experience: 10+ years of data engineering or data analytics consulting experience in an enterprise Azure environment.
Consulting Mindset: Proven ability to dive into unfamiliar data ecosystems, document findings, and provide strategic recommendations to client teams.
Communication: Exceptional verbal and written communication skills, with the ability to explain technical data concepts to non-technical business users.
Education: Bachelor’s degree in Computer Science, Information Systems, Data Analytics, or a related field (or equivalent practical experience)

Work arrangement
Yes