Role: Data  Engineer  (2-3 YEARS)- 5 POSITIONS

Responsibilities: Data Engineer will work on collecting, storing, processing, and analyzing huge sets of data The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company in various products.

• Key Skills:

• 1. Proficient understanding of distributed computing principles
• 2. Ability to build, run and manage large clusters
• 3. Hadoop v2, MapReduce, HDFS
• 4. Java, Python
• 5. Large Scale crawling : Scrapy, Nutch and custom crawling solutions
• 6. Experience with Apache Solr Lucene
• 7. NoSQL databases, such as MongoDB, HBase, Cassandra
• 8. Knowledge of various ETL techniques and frameworks, such as Flume
• 9. Experience with NLP tools and systems for POS, NER, and Information extraction
• 10. Experience with Machine Learning – Regression, Classification, Decision Trees.
• 11. Experience with Linux / AWS
• Key Technologies :
• – Web Scraping
• – NLP
• – NoSQL (MongoDB, Cassandra)
• – Python/JAVA, R
• – Machine Learning (Basics)
• – Big Data

        Tools (Hadoop, Spark, Pig, Hive)

Send your CV for these positions to careers@rightpath.in