Spark Technical Leads/ Architects

6 - 11 Years
Pune

Job Description



Experience: 7+ Years

Primary Skills: Spark, HIVE, Sqoop, Flume, Hbase, Kafka, Hadoop


DataMetica is seeking a Spark Lead & Architect with expert level experience in Spark, Scala & Big Data Technologies and implementing large scale distributed data processing systems. This is a very challenging role at DataMetica with an opportunity for building innovative Hadoop/Big Data products and solutions. You will be responsible to build end to end solutions from scratch. In addition to that you will also be responsible for improving the existing distributed system architecture in our client environment. As a Technical Lead & Architect you would also be part of COE where you would be involved in solving complex business problems, technology comparisons and analyzing and extending distributed architecture patterns and solutions. You would directly working with Chief architects/CTOs/CEOs of clients.

Responsibilities:

  • Hands on technical role; contribute to all phases of the software development lifecycle, including the analysis, architecture, design, implementation, and QA
  • Collaboration on requirements; work with the Engineering, Product Management and Client Success teams to define features to help improve results for our customers and ourselves alike
  • Partner with our Data Mining and Analytics team to do analysis, build predictive models & optimization algorithms, and run experiments
  • Work closely with Operations/IT to assist with requirements and design of Hadoop clusters to handle very large scale; help with troubleshooting operations issues
Requirements:

  • Should have a solid background in the fundamentals of computer science, distributed computing, large scale data processing as well as mastery of database designs and data warehousing. The person should have a high degree of self motivation, an unwavering commitment to excellence, excellent work ethic, positive attitude, and is fun to work with.
  • Expertise in building massively scalable distributed data processing solutions with Hadoop, Hive & Spark, Spark-SQL
  • Proficiency with Big Data processing technologies (Spark, Kafka, Azkaban, Hadoop, HBase, Flume, Oozie)
  • Deep experience with distributed systems, large scale non-relational data stores, map-reduce systems, data modeling, database performance, and multi-terabyte data warehouses
  • Experience in building data pipelines and analysis tools using Java or Python
  • Hands on Java experience building scalable solutions
  • Experience building large-scale server-side systems with distributed ¢processing algorithms.
  • Aptitude to independently learn new technologies
  • Strong problem solving skills
  • Experience designing or implementing systems which work with external vendors' interfaces
  • Ability to communicate with internal teams.

Keyskills

Desired Candidate Profile

Please refer to the Job description above

Education-

UG:B.Tech/B.E. - Computers

Company Profile

Datametica Solutions Pvt Ltd

Datametica is a global leader in Cloud deployments and DevOps for Data Management, Big Data, and Advanced Analytics.

Being a preferred solutions provider, Datametica helps medium and large enterprises to consolidate their data into a modern data platform on the Cloud, move their Legacy Data Warehouses, Hadoop, Mainframe and ETL to the Cloud and modernize analytics capabilities.

Our services and technologies bring experience, and clarity for organizations to migrate their data services and analytics to the cloud with world-leading automation which helps in removing complexity, reducing risk and speeding migration.

Our Datametica Big Data specialists, with the scale, expertise, experience, flexibility, and cultural alignment understands the business, analytics, and data management imperatives of your organization.

Datametica aims to take the fear, uncertainty and risk out of a migration to the Cloud.

We are honored to be a preferred migration, modernization, big data, and analytics solution provider by Google Cloud Platform, Amazon Web Services, and Microsoft Azure.

Datametica: Knowledge, Focus and Integrity.
View Contact Details+

Recruiter Name:Mahesh Bankar

Contact Company:Datametica Solutions Pvt Ltd

Telephone:020-66446310

Reference Id:DM0007

Website:https://www.datametica.com

Salary

Not Disclosed by Recruiter

Role Category

Programming & Design

Role

Technical Architect

Employment Type

Full Time, Permanent