Skip to main content

Data Architect and Data Engineer Requirements with 3-11 years | Bangalore | Hybrid working

 Data Architect and Data Engineer Requirements with  3-11 years | Bangalore | Hybrid working

Data Engineer - JD

We are looking for:

  • 3 to 5 years of relevant data engineering hands-on work experience in data ingestion, processing, exploratory analysis to build solutions that deliver value through data as an asset.
  • Data engineer build, test, and deploy data pipelines efficiently and reliably move data across systems and should be top of latest architectural trends on AZURE cloud.
  • Folks who understand parallel and distributed processing, storage, concurrency, fault-tolerant systems.
  • Folks who thrive on new technologies, able to adapt and learn easily to meet the needs of next-generation engineering challenges.

Technical Skills (Must-Have)

  • Applied experience with distributed data processing frameworks Spark, Databricks with Python and SQL.
  • Must have worked at least 2 end-end data analytics projects with Databricks Configuration, UnityCatalog, Delta Sharing, and medallion architecture.
  • Applied experience with Azure Data services ADLS, Delta Lake, Delta Live Tables, Azure Storage, RBAC.
  • Applied experience with Unit Testing and System Integration Testing using Python framework.
  • Applied experience with DevOps to design and deploy CI/CD pipelines using Jenkins.
  • AZURE Data Engineering(DP203) or DATABRICKS certification.
  • Prior working experience with high-performance agile team- Scrum, JIRA, JFrog, and Confluence.

Nice to have:

  • IoT data-driven product/platform development environment background is a plus.
  • Medical and Healthcare domain expertise is a plus.

    Data Architect JD

    • 5 to 11+ years of experience in Data Engineering platform.
    • Architecting expertise- Data Architecture, ADF, ADLS.
    • Hands-on experience on Azure cloud and Pyspark.
    • Expert in ETL.
    • Knowledge and Hands-on Experience (min 6 months) on Data cataloguing, Data Governance.
    • Azure cloud/Azure services.
    • Nice to have Medical/Healthcare Domain Experience.
    • Excellent communication skills.

    Technical Skills (Must-Have)

    • Applied experience with distributed data processing frameworks- Spark and Databricks with Python.
    • Proficiency in programming language- Python, PySpark.
    • Applied experience with AZURE services ADLS, Delta Lake, Delta Live Tables, Delta Sharing, and Unity Catalog.
    • Applied experience with SQL scripting, CRUD operations on time series databases.
    • Applied experience with Unit Testing and System Integration Testing using Python framework.
    • Applied experience with DevOps to design and deploy CI/CD pipelines using Jenkins.
    • AZURE Data Engineering(DP203) or DATABRICKS certification.


Please share your profiles to 
Email: hr@abfirst.co.in / info@abfirst.co.in

Whatsapp | +91-9686769808
ABFirst | www.abfirst.co.in

#DataEngineer #DataArchitect #AzureCloud #Databricks #Spark #PythonProgramming #SQL #CI_CD #DataPipelines #AzureServices #DataArchitecture #ETL #HybridWork #BangaloreJobs #TechJobs #ITCareers #DistributedProcessing #DataGovernance #UnitTesting #IoT #HealthcareIT #Jenkins #AgileDevelopment #Pyspark #AzureADLS

Comments

Post a Comment

Popular posts from this blog

.Net Developer | Exp 5 to 8 years | Location: Bangalore

JD-1: .Net Developer Net Framework 4.0 and above C# programming, Win forms, WPF,  WCF Data base systems - MySQL, Postgress Should have worked on Hardware integrated systems (Protocol: RS 485, Modbus)  Exp 5 to 8 years  Location: Bangalore .Net Developer Bangalore, C# programming Bangalore, WPF Developer Bangalore, WinForms Developer Bangalore, WCF Developer Bangalore, MySQL Developer Bangalore, Postgres Developer Bangalore, Hardware Integrated Systems Developer, RS 485 Protocol Developer, Modbus Protocol Developer, Experienced .Net Developer 5-8 years, .Net Developer Jobs Bangalore, Software Engineer Staffing Bangalore #DotNetDeveloper, #CSharpProgramming, #WinForms, #WPFDeveloper, #WCFServices, #MySQL, #Postgres, #HardwareIntegration, #RS485, #Modbus, #ExperiencedDeveloper, #BangaloreJobs, #SoftwareEngineerJobs Best regards, HR Team ABFirst Pvt. Ltd Email: hr@abfirst.co.in Phone: +91-9686769808
Post a Comment
Read more

Urgent Requirement Python Developer (5-7 Years) | Hyderabad location

Urgent Requirement  Python Developer (5-7 Years) |  Hyderabad location Job Title: Experienced Python Developer (5-7 Years) Location: Hyderabad, India Job Description: We are seeking highly skilled Python Developers with 5 to 7 years of experience Please share your profiles to  Email: hr @abfirst.co.in  / info@abfirst.co.in Whatsapp | +91-9686769808 ABFirst |  www.abfirst.co.in ABFirst is a leading development and outsourcing company in India, specializing in IT solutions across various domains. We offer a wide range of services, including Staffing, RPO, Outsourcing, Near Source, and Outsourced Product Development. We work with cutting-edge technologies such as .NET, Java, Python, DPA, Cloud, AI/ML, Analytics, and Advanced Analytics.  #PythonDeveloper #HyderabadJobs #ITJobsIndia #SoftwareDeveloper #PythonJobs #TechCareers #HiringNow #JobOpening #CareerOpportunities #DeveloperJobs #ABFirstCareers #PythonProgramming #Django #Flask #HyderabadCareers #Cloud...
Post a Comment
Read more

Power Bi, SQL And DOT.Net Developer with 5 to 10 years for -Mumbai Location(worli)

Power Bi, SQL And DOT.Net Developer with 5 to 10 years for -Mumbai Location(worli)    Position title:   Power Bi, SQL And DOT.Net Developer Work Experience:  5 to 10 years Location-Mumbai (worli) Budget- 14-15lpa This requirement closed within one week so please look immediate joiner or serving notice period. Job Purpose We are currently seeking an experienced and skilled Senior Business Intelligence Developer to join our P&F IT team. The ideal candidate will be responsible for development, deployment, and administration of various solutions, with, expertise in Power BI, SQL, Dot.Net, Power Apps, SharePoint, Data Warehousing, Data Modeling, ETL and advanced data analysis. This role requires someone with a strong technical background in programming languages like C, C++, and Python, raw data into actionable insights. Skills and Abilities • Design, develop, and implement effective data models, reports, and visualizations using Power BI, Power Apps, and other BI too...
Post a Comment
Read more