Skip to main content

Data Architect and Data Engineer Requirements with 3-11 years | Bangalore | Hybrid working

 Data Architect and Data Engineer Requirements with  3-11 years | Bangalore | Hybrid working

Data Engineer - JD

We are looking for:

  • 3 to 5 years of relevant data engineering hands-on work experience in data ingestion, processing, exploratory analysis to build solutions that deliver value through data as an asset.
  • Data engineer build, test, and deploy data pipelines efficiently and reliably move data across systems and should be top of latest architectural trends on AZURE cloud.
  • Folks who understand parallel and distributed processing, storage, concurrency, fault-tolerant systems.
  • Folks who thrive on new technologies, able to adapt and learn easily to meet the needs of next-generation engineering challenges.

Technical Skills (Must-Have)

  • Applied experience with distributed data processing frameworks Spark, Databricks with Python and SQL.
  • Must have worked at least 2 end-end data analytics projects with Databricks Configuration, UnityCatalog, Delta Sharing, and medallion architecture.
  • Applied experience with Azure Data services ADLS, Delta Lake, Delta Live Tables, Azure Storage, RBAC.
  • Applied experience with Unit Testing and System Integration Testing using Python framework.
  • Applied experience with DevOps to design and deploy CI/CD pipelines using Jenkins.
  • AZURE Data Engineering(DP203) or DATABRICKS certification.
  • Prior working experience with high-performance agile team- Scrum, JIRA, JFrog, and Confluence.

Nice to have:

  • IoT data-driven product/platform development environment background is a plus.
  • Medical and Healthcare domain expertise is a plus.

    Data Architect JD

    • 5 to 11+ years of experience in Data Engineering platform.
    • Architecting expertise- Data Architecture, ADF, ADLS.
    • Hands-on experience on Azure cloud and Pyspark.
    • Expert in ETL.
    • Knowledge and Hands-on Experience (min 6 months) on Data cataloguing, Data Governance.
    • Azure cloud/Azure services.
    • Nice to have Medical/Healthcare Domain Experience.
    • Excellent communication skills.

    Technical Skills (Must-Have)

    • Applied experience with distributed data processing frameworks- Spark and Databricks with Python.
    • Proficiency in programming language- Python, PySpark.
    • Applied experience with AZURE services ADLS, Delta Lake, Delta Live Tables, Delta Sharing, and Unity Catalog.
    • Applied experience with SQL scripting, CRUD operations on time series databases.
    • Applied experience with Unit Testing and System Integration Testing using Python framework.
    • Applied experience with DevOps to design and deploy CI/CD pipelines using Jenkins.
    • AZURE Data Engineering(DP203) or DATABRICKS certification.


Please share your profiles to 
Email: hr@abfirst.co.in / info@abfirst.co.in

Whatsapp | +91-9686769808
ABFirst | www.abfirst.co.in

#DataEngineer #DataArchitect #AzureCloud #Databricks #Spark #PythonProgramming #SQL #CI_CD #DataPipelines #AzureServices #DataArchitecture #ETL #HybridWork #BangaloreJobs #TechJobs #ITCareers #DistributedProcessing #DataGovernance #UnitTesting #IoT #HealthcareIT #Jenkins #AgileDevelopment #Pyspark #AzureADLS

Comments

Post a Comment

Popular posts from this blog

.Net Developer | Exp 5 to 8 years | Location: Bangalore

JD-1: .Net Developer Net Framework 4.0 and above C# programming, Win forms, WPF,  WCF Data base systems - MySQL, Postgress Should have worked on Hardware integrated systems (Protocol: RS 485, Modbus)  Exp 5 to 8 years  Location: Bangalore .Net Developer Bangalore, C# programming Bangalore, WPF Developer Bangalore, WinForms Developer Bangalore, WCF Developer Bangalore, MySQL Developer Bangalore, Postgres Developer Bangalore, Hardware Integrated Systems Developer, RS 485 Protocol Developer, Modbus Protocol Developer, Experienced .Net Developer 5-8 years, .Net Developer Jobs Bangalore, Software Engineer Staffing Bangalore #DotNetDeveloper, #CSharpProgramming, #WinForms, #WPFDeveloper, #WCFServices, #MySQL, #Postgres, #HardwareIntegration, #RS485, #Modbus, #ExperiencedDeveloper, #BangaloreJobs, #SoftwareEngineerJobs Best regards, HR Team ABFirst Pvt. Ltd Email: hr@abfirst.co.in Phone: +91-9686769808
Post a Comment
Read more

Back End Engineer C# | Remote (India) | Experience: 6-10years

 Client is Emagine UK Job Title: Back End Engineer C#  Location: Remote (India) Experience: 6-10years Technical - sound commercial experience in the following: • C#, .Net Core, Web API, REST API, Entity Framework, • SQL / PostgreSQL • (CI/CD) within Azure Devops. • Azure PaaS services (App Services, Function Apps, API Management, Service Bus, Azure Storage, Key Vaults, Azure SQL, Azure CosmosDb, Azure AD).  • Experience of Webservices, Web API, Swagger, Postman & Microsoft APIM • Experienced in an Agile delivery environment   • Understanding of design documentation, UML, Entity Relationship Diagramming etc. Technical - Commercial experience in some of the following: • Azure Container Apps • Azure PowerShell, Terraform. Non- Technical • Good interpersonal skills with a key ability to work with an Agile team • Excellent analytical and technical skills. • Ability to think out of the box and deliver on the agreed solutions to business pro...
Post a Comment
Read more

Blog Post: Custom Software Development: Elevate Your Business with ABfirst Pvt Ltd

  ntroduction In a competitive business landscape, custom software development can provide the edge you need to stay ahead. ABfirst Pvt Ltd specializes in developing bespoke software solutions that cater to your unique business requirements. Learn how our custom software development services can benefit your organization. Our Custom Software Development Approach Requirement Analysis : We begin by thoroughly understanding your business needs and objectives to create a solution that fits perfectly. Innovative Solutions : Our team leverages the latest technologies to develop innovative software that drives business growth. Quality Assurance : Rigorous testing ensures that our software solutions are reliable, efficient, and free of bugs. Continuous Improvement : We provide ongoing support and updates to keep your software up-to-date with evolving business needs and technological advancements.
1 comment
Read more