Skip to main content

Data Architect and Data Engineer Requirements with 3-11 years | Bangalore | Hybrid working

 Data Architect and Data Engineer Requirements with  3-11 years | Bangalore | Hybrid working

Data Engineer - JD

We are looking for:

  • 3 to 5 years of relevant data engineering hands-on work experience in data ingestion, processing, exploratory analysis to build solutions that deliver value through data as an asset.
  • Data engineer build, test, and deploy data pipelines efficiently and reliably move data across systems and should be top of latest architectural trends on AZURE cloud.
  • Folks who understand parallel and distributed processing, storage, concurrency, fault-tolerant systems.
  • Folks who thrive on new technologies, able to adapt and learn easily to meet the needs of next-generation engineering challenges.

Technical Skills (Must-Have)

  • Applied experience with distributed data processing frameworks Spark, Databricks with Python and SQL.
  • Must have worked at least 2 end-end data analytics projects with Databricks Configuration, UnityCatalog, Delta Sharing, and medallion architecture.
  • Applied experience with Azure Data services ADLS, Delta Lake, Delta Live Tables, Azure Storage, RBAC.
  • Applied experience with Unit Testing and System Integration Testing using Python framework.
  • Applied experience with DevOps to design and deploy CI/CD pipelines using Jenkins.
  • AZURE Data Engineering(DP203) or DATABRICKS certification.
  • Prior working experience with high-performance agile team- Scrum, JIRA, JFrog, and Confluence.

Nice to have:

  • IoT data-driven product/platform development environment background is a plus.
  • Medical and Healthcare domain expertise is a plus.

    Data Architect JD

    • 5 to 11+ years of experience in Data Engineering platform.
    • Architecting expertise- Data Architecture, ADF, ADLS.
    • Hands-on experience on Azure cloud and Pyspark.
    • Expert in ETL.
    • Knowledge and Hands-on Experience (min 6 months) on Data cataloguing, Data Governance.
    • Azure cloud/Azure services.
    • Nice to have Medical/Healthcare Domain Experience.
    • Excellent communication skills.

    Technical Skills (Must-Have)

    • Applied experience with distributed data processing frameworks- Spark and Databricks with Python.
    • Proficiency in programming language- Python, PySpark.
    • Applied experience with AZURE services ADLS, Delta Lake, Delta Live Tables, Delta Sharing, and Unity Catalog.
    • Applied experience with SQL scripting, CRUD operations on time series databases.
    • Applied experience with Unit Testing and System Integration Testing using Python framework.
    • Applied experience with DevOps to design and deploy CI/CD pipelines using Jenkins.
    • AZURE Data Engineering(DP203) or DATABRICKS certification.


Please share your profiles to 
Email: hr@abfirst.co.in / info@abfirst.co.in

Whatsapp | +91-9686769808
ABFirst | www.abfirst.co.in

#DataEngineer #DataArchitect #AzureCloud #Databricks #Spark #PythonProgramming #SQL #CI_CD #DataPipelines #AzureServices #DataArchitecture #ETL #HybridWork #BangaloreJobs #TechJobs #ITCareers #DistributedProcessing #DataGovernance #UnitTesting #IoT #HealthcareIT #Jenkins #AgileDevelopment #Pyspark #AzureADLS

Comments

Post a Comment

Popular posts from this blog

SAS DI Developers | 4 -6 Years | Bangalore | Hyderabad | Chennai

  SAS DI Developers | 4 -6 Years | Bangalore | Hyderabad | Chennai Desired Competencies (Technical/Behavioral Competency) Must-Have (Ideally should not be more than 4-6): Experience in SAS V6.0 - Data Integration Development and Support. Experience working in SAS ETL, COGNOS, DB2 SQL and PLI. Defining architecture of the platform for SAS Business Analytics. Creating metadata for source, target data and jobs. Experience with transformations and table loader transformations. Deploying JOBS Good-to-Have : Airline Domain Knowledge Azure cloud hosted environment. Please share your profiles to  Email: hr @abfirst.co.in  / info@abfirst.co.in Whatsapp | +91-9686769808 ABFirst |  www.abfirst.co.in ABFirst is a leading development and outsourcing company in India, specializing in IT solutions across various domains. We offer a wide range of services, including Staffing, RPO, Outsourcing, Near Source, and Outsourced Product Development. We work with cutting-edge technologies s...
Post a Comment
Read more

Blog Post: Custom Software Development: Elevate Your Business with ABfirst Pvt Ltd

  ntroduction In a competitive business landscape, custom software development can provide the edge you need to stay ahead. ABfirst Pvt Ltd specializes in developing bespoke software solutions that cater to your unique business requirements. Learn how our custom software development services can benefit your organization. Our Custom Software Development Approach Requirement Analysis : We begin by thoroughly understanding your business needs and objectives to create a solution that fits perfectly. Innovative Solutions : Our team leverages the latest technologies to develop innovative software that drives business growth. Quality Assurance : Rigorous testing ensures that our software solutions are reliable, efficient, and free of bugs. Continuous Improvement : We provide ongoing support and updates to keep your software up-to-date with evolving business needs and technological advancements.
1 comment
Read more

.Net Developer | Exp 5 to 8 years | Location: Bangalore

JD-1: .Net Developer Net Framework 4.0 and above C# programming, Win forms, WPF,  WCF Data base systems - MySQL, Postgress Should have worked on Hardware integrated systems (Protocol: RS 485, Modbus)  Exp 5 to 8 years  Location: Bangalore .Net Developer Bangalore, C# programming Bangalore, WPF Developer Bangalore, WinForms Developer Bangalore, WCF Developer Bangalore, MySQL Developer Bangalore, Postgres Developer Bangalore, Hardware Integrated Systems Developer, RS 485 Protocol Developer, Modbus Protocol Developer, Experienced .Net Developer 5-8 years, .Net Developer Jobs Bangalore, Software Engineer Staffing Bangalore #DotNetDeveloper, #CSharpProgramming, #WinForms, #WPFDeveloper, #WCFServices, #MySQL, #Postgres, #HardwareIntegration, #RS485, #Modbus, #ExperiencedDeveloper, #BangaloreJobs, #SoftwareEngineerJobs Best regards, HR Team ABFirst Pvt. Ltd Email: hr@abfirst.co.in Phone: +91-9686769808
Post a Comment
Read more