Senior Big Data Engineer

Location: Lviv, Ukraine
Date Posted: 05-19-2017
Sr. Big Data Engineer 
Location: Lviv, Ukraine,  Cambridge, MA, Santa Clara, CA - could be open to other locations for the right candidate. 
 
As a core engineering team member, this development position requires the creation and enhancement of an early stage Hadoop/Spark ecosystem built to handle data at the scale of today’s largest Internet properties. The successful candidate will be someone who enjoys building very large-scale business critical data systems with the challenge of low latency access for both historical (including Billing) and real time application.  You must be passionate about Big Data and be able to contemplate new and valuable uses of the data.
 
You must be able to work in a team environment, be a problem solver that is able to communicate and prioritize in a fast moving challenging, stimulating, and rewarding environment.
 
Responsibilities
 
- Enhance as required the Flume-based Data Acquisition Pipeline
- Enhance as required Hadoop/Spark infrastructure 
- Contribute to the ideation of new uses of data and new data centric services
- Own CI automated build and tests
- Create Map/Reduce for specific reporting and billing requirements
- Create readers/writers to message bus (Kafka, MapR Streams, etc.)
- Dig deep into any performance, scalability, capacity or reliability problem in order to resolve the issues
 
Qualifications
 
- Proven experience building and scaling out a Hadoop based ecosystem for a large-scale on-line Service
- 10+ years of professional software engineering experience preferably in online service oriented businesses
- 1+ year's experience in Hadoop administration 
- 1+ years of experience writing Map/Reduce jobs preferably running under Spark in Java or Scala
- 1+ years of experience using NoSQL databases such as HBase or Cassandra
- 1+ years of experience with DevOps frameworks such as SaltStack, Chef, Puppet, Ansible, or similar technology stack experience 
- Experience writing software in Continuous Integration and automated deployment environment
- Prior analytics experience in Global Content Delivery is a plus
- Prior experience in MapR platform is a plus
 
About VidScale
 
VidScale is the first end-to-end Content Delivery solution in the OEM market that combines Content Delivery from Origin to Edge, Just-in-time-Packaging, Request Routing, and Analytics.
 
Located in Cambridge Massachusetts with Tier-1 Service Provider suppliers as OEM customers and developers located all over the world, VidScale is poised to disrupt the Content Delivery market in a very big way.
or
this job portal is powered by CATS