Data Engineer - Spark at NTT Data Services

Job Description

NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.

We are currently seeking a Data Bricks Engineer to join our team in Hyderabad, Andhra Pradesh (IN-AP), India (IN).

• Experience in Azure data service and products (i.e. Data Factory, Data Lake Analytics, Analysis services, Azure stream analytics)
• Experience in Big Data components such as Kafka, Spark SQL, Data frames, HIVE DB etc implemented using Azure Data Bricks would be preferred.
• Azure Databricks integration with other services
• Read and write data in Azure Databricks

• Best practices in Azure Databricks • Experience in SQL Server Integration Services (SSIS) and SQL Server Analysis Services (SSAS)

• Design & implementation solutions on MS Azure Platforms

• Designed & architected scalable data processing and analytics solutions, including technical feasibility, integration, development for Big Data storage, processing & consumption of Azure data, analytics, big data (Hadoop, Spark), NoSQL, HDInsight, Stream Analytics, Data Factory etc.
• Expert level understanding and knowledge on Azure Data Services including ADF, ADLS, Blob, Data Bricks with a background of Python & Spark.
• Experience in Azure data service and products (i.e. Data Factory, Data Lake Analytics, Analysis services, Azure stream analytics)
• Knowledge on one or more Azure SQL database(Cosmos DB/SQL ), Azure app service (websites), Service Bus, Azure Storage (blob, table, queues), Stream Analytics
• Strong understanding on Microsoft Azure services (Virtual Machines, Websites, Storage Blobs, SQL Database, Virtual Network, Traffic Manager, Automation, Active Directory)
• Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime.
• In-depth understanding of capabilities & limitations of various Azure components like IoT Hub/Event Hub, Azure Active Directory, AZURE
  Machine Learning Studio, AZURE Logic App, HDInsight’s. Hands on
  experience of configuring and deploying applications using Microsoft Azure. Experience in designing REST APIs and database schema would
  be good to have. Good to have knowledge on edge device connectivity, device management, data ingestion, streaming & big-data analytics,
  visualizations, API interfaces.

Required Skills

This is your progress in the required skills for this job. Sign in and improve your score by completing these topics and then apply for the job with a better profile.