Open to opportunities · Building cool things
👋
Hello, I'm
NITIN
↑ hover the name!
Data Engineer
I'm a Data Engineer, passionate about building scalable data systems and pipelines that power products with the potential to impact millions of lives.
Focused on transforming complex data into actionable insights to solve real-world challenges.
3+
Years Exp
10+
Projects
15+
Tech Stack
My Tech Stack
The core technologies I use to build scalable data platforms. Click any item for details.
DatabricksDelta LakeUnity CatalogLakeflowDelta Live TablesDLTAuto LoaderDatabricks SQLDatabricks WorkflowsMLflowPhoton EngineDatabricks Asset BundlesLiquid ClusteringPredictive OptimizationZ-Order IndexingServerless SQL WarehousesLakeflow Declarative PipelinesFederated Computational GovernancePySparkSpark SQLSpark Structured StreamingDataFramesRDDsAdaptive Query ExecutionAQEBroadcast JoinsDatabricksDelta LakeUnity CatalogLakeflowDelta Live TablesDLTAuto LoaderDatabricks SQLDatabricks WorkflowsMLflowPhoton EngineDatabricks Asset BundlesLiquid ClusteringPredictive OptimizationZ-Order IndexingServerless SQL WarehousesLakeflow Declarative PipelinesFederated Computational GovernancePySparkSpark SQLSpark Structured StreamingDataFramesRDDsAdaptive Query ExecutionAQEBroadcast Joins
Spark Job OptimizationNarrow TransformationsWide TransformationsCatalyst OptimizerDistributed ComputingMedallion ArchitectureBronze Silver GoldLakehouse ArchitectureLambda ArchitectureKappa ArchitectureData MeshData FabricMulti-hop ArchitectureEvent-driven ArchitectureMicroservicesData ContractsETLELTBatch ProcessingStreaming ETLIncremental LoadCDCChange Data CaptureSCD Type 1SCD Type 2Data IngestionSpark Job OptimizationNarrow TransformationsWide TransformationsCatalyst OptimizerDistributed ComputingMedallion ArchitectureBronze Silver GoldLakehouse ArchitectureLambda ArchitectureKappa ArchitectureData MeshData FabricMulti-hop ArchitectureEvent-driven ArchitectureMicroservicesData ContractsETLELTBatch ProcessingStreaming ETLIncremental LoadCDCChange Data CaptureSCD Type 1SCD Type 2Data Ingestion
Data TransformationPipeline OrchestrationWorkflow AutomationReal-Time IngestionStream ProcessingAzure Data FactoryADFADLS Gen2Azure Synapse AnalyticsAzure DevOpsAzure Key VaultAzure MonitorMicrosoft FabricOneLakeDirect LakeFabric WorkspacesKQLKusto Query LanguageData GovernanceData LineageData CatalogData QualitySchema EnforcementSchema EvolutionACID ComplianceData ObservabilityData TransformationPipeline OrchestrationWorkflow AutomationReal-Time IngestionStream ProcessingAzure Data FactoryADFADLS Gen2Azure Synapse AnalyticsAzure DevOpsAzure Key VaultAzure MonitorMicrosoft FabricOneLakeDirect LakeFabric WorkspacesKQLKusto Query LanguageData GovernanceData LineageData CatalogData QualitySchema EnforcementSchema EvolutionACID ComplianceData Observability
GDPRRow-level SecurityColumn-level SecurityFinOpsCloud Cost ManagementdbtSemantic LayerMetricFlowApache KafkaApache AirflowApache IcebergApache SparkTerraformDockerKubernetesCI/CDPostgreSQLPythonSQLScalaPandasNumPySparkSQLWindow FunctionsCTEsQuery OptimizationGDPRRow-level SecurityColumn-level SecurityFinOpsCloud Cost ManagementdbtSemantic LayerMetricFlowApache KafkaApache AirflowApache IcebergApache SparkTerraformDockerKubernetesCI/CDPostgreSQLPythonSQLScalaPandasNumPySparkSQLWindow FunctionsCTEsQuery Optimization
Data ModelingStar SchemaSnowflake SchemaDimensional ModelingMaterialized ViewsPartitioningParquetSnowflakeAmazon RedshiftGoogle BigQueryRAGRetrieval-Augmented GenerationLLM Data PipelinesAgentic AIFeature StoresVector SearchVector EmbeddingsChromaDBPineconeGreat Expectationsdbt TestsPySpark Unit TestsData Reliability EngineeringData ModelingStar SchemaSnowflake SchemaDimensional ModelingMaterialized ViewsPartitioningParquetSnowflakeAmazon RedshiftGoogle BigQueryRAGRetrieval-Augmented GenerationLLM Data PipelinesAgentic AIFeature StoresVector SearchVector EmbeddingsChromaDBPineconeGreat Expectationsdbt TestsPySpark Unit TestsData Reliability Engineering