Assistant Manager/ Manager- Data Engineer Full-time

SMART CUBE INDIA PRIVATE LIMITED

Posted By : SMART CUBE INDIA PRIVATE LIMITED

Bengaluru, Karnataka (1)Chennai, Tamil Nadu (1)Gurugram, Haryana (1)Kolkata, West Bengal (1)Mumbai, Maharashtra (1)Noida, Uttar Pradesh (1)Pune, Maharashtra (1)

What job we expect you to do:

  • Connecting, designing, scheduling, and deploying data warehouse systems
  • Developing data pipelines and enable dash boards for stakeholders and
  • Develop, construct, test and maintain system architectures
  • Create best practices for data loading and extraction
  • Doing quick POCs for any data eccentric development task

 

 

What skills we expect you to bring:

  • Strong programing skills, being well versed in Object-Oriented Programming system (OOPS), data structures, and algorithms
  • Should be comfortable in executing ETL (Extract, Transform and Load) processes which include data ingestion, data cleaning and curation into a data warehouse, database, or data platform
  • Should be comfortable with schema designing
  • Experience in distributed computing environment
  • Experience in structured/unstructured data and batch processing/real-time processing (good to have)
  • Be comfortable with SQL (mandatory), Python(mandatory), Scala (good to have)  to manipulate and prepare data and conduct various analysis as needed
  • Reading\writing data to\from various sources - APIs, cloud storage, databases, big data platforms
  • Experience of working with Big Data environment such as Hadoop and the ecosystem
  • Data transformations and applying ML models
  • Creating web services to allow create, read, update and delete (CRUD) operations
  • Competent in project management framework such as Agile
  • Excellent communication skills, both written and verbal

 

What expertise will bring added advantage?

  • Machine learning
  • Statistical Modelling
  • Natural Language Processing

 

What Tools and Technologies we expect you to know?  We understand one cannot be master of all.

  • Python - pandas, django\flask, sklearn, scikit
  • SQL, BigQuery
  • Hadoop ecosystems (HDFS, HIVE, Mapreduce, Pig, Spark, Hadoop etc.)
  • Kafka
  • Apache Spark
  • Linux
  • Airflow

 

How many years of experience do you need?

Minimum 4 years of relevant experience

 

Where is the job location?

We are ready to welcome you at Noida and Gurgaon and also open for any other location in India

 

Role Specific Skills
  • Active Learning
  • Active Listening
  • Category Flexibility
  • Complex Problem Solving
  • Computers and Electronics
  • Coordination
  • Critical Thinking
  • Deductive Reasoning
  • Design
  • Engineering and Technology
  • English Language
  • Fluency of Ideas
  • Inductive Reasoning
  • Information Ordering
  • Judgment and Decision Making
  • Mathematics
  • Monitoring
  • Near Vision
  • Oral Comprehension
  • Oral Expression
  • Problem Sensitivity
  • Programming
  • Reading Comprehension
  • Selective Attention
  • Social Perceptiveness
  • Speaking
  • Speech Clarity
  • Speech Recognition
  • Systems Analysis
  • Systems Evaluation
  • Writing
  • Written Comprehension
  • Written Expression

Bachelor of Engineering (B.E) - Any Specialization

Bachelor of Technology (B.Tech) - Others

Journey