Top 10 TCS Azure Data Factory & Azure Databricks Interview Questions (2026)
Prepare for TCS Azure Data Engineer interviews with the most frequently asked Azure Data Factory, Azure Databricks, ADLS Gen2, Delta Lake, PySpark, SQL and ETL interview questions.
Top 8 TCS Azure Data Engineer Interview Questions
TCS Azure Data Engineer interviews primarily focus on Azure Data Factory (ADF), Azure Databricks, ADLS Gen2, Azure SQL Database, Azure Synapse Analytics, PySpark, Spark architecture, ETL pipelines, and real-world production scenarios. Candidates are expected to explain concepts with practical examples and demonstrate knowledge of optimization, security, and troubleshooting.
1. How many jobs, stages, and tasks are created during a Spark job execution?
In Apache Spark, an action such as collect(), count(), show(), or write() triggers a Job. Each job is divided into one or more Stages based on shuffle boundaries created by wide transformations like groupBy(), join(), or reduceByKey(). Every stage is further divided into multiple Tasks, where each task processes a single partition of data in parallel.
Action (count, collect, save)
ā
ā¼
1 Job
ā
ā¼
Stage 1 (Before Shuffle)
ā
Multiple Tasks
ā
Wide Transformation
(groupBy / join)
ā
ā¼
Stage 2 (After Shuffle)
ā
Multiple TasksInterview Tip
Remember that Jobs are created by Actions, Stages are created by Shuffle operations, and Tasks are created based on the number of partitions.
2. What are the activities available in Azure Data Factory?
Azure Data Factory provides several activities for data movement, transformation, and orchestration. Copy Activity transfers data between source and destination. Mapping Data Flow performs visual ETL transformations. Notebook Activity executes Azure Databricks notebooks. Stored Procedure Activity executes SQL procedures. Web Activity invokes REST APIs, while Lookup, Get Metadata, Set Variable, ForEach, and If Condition activities help control pipeline execution.
⢠Copy Activity
⢠Mapping Data Flow
⢠Databricks Notebook Activity
⢠Stored Procedure Activity
⢠Lookup Activity
⢠Get Metadata Activity
⢠Web Activity
⢠Execute Pipeline Activity
⢠ForEach Activity
⢠If Condition
⢠Set Variable Activity3. How do you integrate ADLS Gen2 with Azure Databricks?
The recommended production approach is to authenticate using a Service Principal with OAuth. Credentials are securely stored in Azure Key Vault or Databricks Secret Scope. After authentication, the ADLS Gen2 container is mounted into Databricks so that it can be accessed like a local file system for reading and writing data.
configs = {
"fs.azure.account.auth.type": "OAuth",
"fs.azure.account.oauth.provider.type":
"org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider",
"fs.azure.account.oauth2.client.id":
"<client-id>",
"fs.azure.account.oauth2.client.secret":
dbutils.secrets.get(
scope="kv-scope",
key="client-secret"
),
"fs.azure.account.oauth2.client.endpoint":
"https://login.microsoftonline.com/<tenant-id>/oauth2/token"
}
dbutils.fs.mount(
source="abfss://<container>@<storage>.dfs.core.windows.net/",
mount_point="/mnt/datalake",
extra_configs=configs
)4. Write a Python program to check whether a string is a palindrome.
A palindrome is a string that reads the same from left to right and right to left. The easiest approach is to compare the string with its reverse after converting it to lowercase and removing spaces.
def is_palindrome(text):
text = text.lower().replace(" ", "")
return text == text[::-1]
print(is_palindrome("Madam"))
print(is_palindrome("Azure"))5. How do you implement data governance in a data lake?
Data governance ensures that enterprise data remains secure, discoverable, and compliant. Microsoft Purview is commonly used for metadata management, data cataloging, lineage tracking, and data classification. ADLS Gen2 uses RBAC and Access Control Lists (ACLs) for authorization, while Delta Lake provides schema enforcement and auditing capabilities to maintain data quality.
Data Governance
⢠Microsoft Purview
⢠Data Catalog
⢠Data Lineage
⢠Data Classification
⢠RBAC
⢠ACLs
⢠Audit Logs
⢠Schema Enforcement (Delta Lake)6. What is the difference between Azure SQL Database and Azure SQL Managed Instance?
Azure SQL Database is a fully managed Platform-as-a-Service database designed for modern cloud applications. Azure SQL Managed Instance provides almost complete SQL Server compatibility, making it ideal for migrating existing on-premises SQL Server applications without major code changes.
Azure SQL Database
--------------------
⢠Cloud-native
⢠Limited SQL Server features
⢠Best for new applications
Azure SQL Managed Instance
---------------------------
⢠Near 100% SQL Server compatibility
⢠Supports SQL Agent
⢠Supports Linked Servers
⢠VNET Integration
⢠Best for Lift-and-Shift migrations7. How do you monitor and troubleshoot Azure SQL Database?
Azure SQL Database can be monitored using Query Performance Insight, Azure Monitor, Log Analytics, SQL Auditing, and Dynamic Management Views (DMVs). During troubleshooting, analyze long-running queries, deadlocks, execution plans, CPU utilization, memory usage, and blocking sessions using system views such as sys.dm_exec_requests and sys.dm_exec_query_stats.
SELECT *
FROM sys.dm_exec_requests;
SELECT *
FROM sys.dm_exec_query_stats;8. Describe the data ingestion process in Azure Synapse Analytics.
Azure Synapse supports both batch and streaming data ingestion. Batch data can be loaded using COPY INTO, PolyBase, or Synapse Pipelines from Azure Data Lake Storage, Blob Storage, or SQL databases. Streaming data is ingested through Event Hubs or Apache Kafka into Spark pools. The ingested data can then be stored in Dedicated SQL Pools, Serverless SQL Pools, or Delta Lake depending on the architecture.
ADLS / Blob / SQL Database
ā
ā¼
Synapse Pipelines
ā
ā¼
COPY INTO / PolyBase
ā
ā¼
Dedicated SQL Pool
Serverless SQL Pool
Spark PoolTCS Interview Tip
Most TCS Azure Data Engineer interviews emphasize production scenarios. Whenever you answer a question, explain the business requirement, Azure services used, implementation steps, performance optimization techniques, and security best practices to demonstrate hands-on experience.