Azure Data Engineer w/ Python/C# Job at Expert In Recruitment Solutions, Tampa, FL

MnM3dzB0VkZLNVgrdnVqakVpcFhCcmlrOFE9PQ==
  • Expert In Recruitment Solutions
  • Tampa, FL

Job Description

Title: Azure Data Engineer w/ Python/C#

Location: 100% Remote

Duration: long term

Interview Mode: Video

Need 12-13+ years candidate

" PySpark or Scala

" Spark SQL

" Delta lakes

* Python/C#

PRIMARY DUTIES AND ACCOUNTABILITIES

Item Accountability %

1 Create and maintain optimal data pipeline architecture 20

2 Assemble large, complex data sets that meet functional / non-functional business requirements. 20

3 Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. 20

4 Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Big Data technologies. 20

5 Deliver automation & lean processes to ensure high quality throughput & performance of the entire data & analytics platform.? 10

6 Work with data and analytics experts to strive for greater functionality in our analytics platforms. 10

POSITION SPECIFICATIONS

Minimum: Preferred:

" Experience in building/operating/maintaining fault tolerant and scalable data processing integrations using Azure

" Strong problem-solving skills with emphasis on optimization data pipelines

" Excellent written and verbal communication skills for coordinating across teams

" A drive to learn and master new technologies and techniques

" Experienced in DevOps and Agile

" Experience using Docker or Kubernetes is a plus

" Demonstrated capabilities with cloud infrastructures and multi-cloud environments such as Azure, AWS, IBM cloud environments and using CI/CD pipelines.

" Experience with Delta Lakes

" Experienced using Databricks & Apache Spark

" Experienced using Azure Data Factory or Synapse Analytics

Job Tags

Permanent employment, Remote job,

Similar Jobs

Central Carolina Hospital

Medical Office Receptionist Job at Central Carolina Hospital

Job Description Who We Are: What sets Central Carolina Hospital apart from the rest? Simply put, its our people. At CCH, youll join a team thats truly dedicated to improving the health of the community we know and love. We live here. Our patients are...

NewFields

Site Safety Officer Job at NewFields

 ...NewFields is an environmental, engineering, and construction management consulting firm with offices worldwide. Since 1995 we have been providing businesses...  ...Manager and Project Management Team with site health and safety ("H&S") system planning, monitoring, changes, and... 

NYC Health + Hospitals

Training Director, Transitional Care Management (Registered Nurse Required) Job at NYC Health + Hospitals

 ...Job Description About NYC Health + Hospitals: Empower Every New Yorker Without Exception to Live the Healthiest Life Possible...  ..., Accountability, Respect, and Excellence) through empathic communication and partnerships between all persons. Job Description:... 

PromptCare

Licensed Practical Nurse (LPN) - Respiratory Division Job at PromptCare

 ...motivated and compassionate individual to join our team as an Entry Level LPN. As an LPN, you will be responsible for non-clinical...  ...quality patient care and are looking for a rewarding career in healthcare, we encourage you to apply for this exciting opportunity. If... 

Remedy Intelligent Staffing

Electrician Industrial (Direct Hire) Job at Remedy Intelligent Staffing

Job Description Job Description Great Opportunity to Join this well-established global company thats been in business for generations! Job Title: Electrical Mechanic Job Type: Full Time / Direct Hire Location: Canandaigua , NY area Company: A well-...