2022-07-29 11:26:48

Data warehouse expert

CVMarket.lt klientas

Job Description

We collect information about users’ interactions with ads from different locations: USA, Brazil and Europe. We get around 3 billion transactions per day and this number constantly grows as we step into new markets in an aggressive manner. We store at the moment around 120 TB of data, but it’s not the limit. We experiment with various technologies to support such level of growth. We are looking for an individual who has built similar systems from the ground up and has extensive experience in implementing solutions around Big Data topic and has deep Hadoop knowledge. The vision of project is to architect a reliable and scalable data platform, provide standard interfaces to query and support analytics for our big data sets that is transparent, efficient and easy to access as possible by our varied applications. This individual also understands the challenges of Big Data across distributed systems, understands replication and synchronization among many machines. We are building new platform using Vertica, Hadoop and Aerospike. We would like you to: - Design, architect and build a data platform over Big Data Technologies - Lead innovations by exploring, investigating, recommending, benchmarking and implementing data centric technologies for the platform

Requirements

We expect that you have: - 2+ years of hands-on experience with the Hadoop stack (MapReduce Programming Paradigm, HBase, Pig, Hive, Sqoop) - 2+ years of hands-on experience with administration, configuration management, monitoring, debugging, benchmarking and performance tuning of Hadoop - 5+ years hands-on experience with open source software platforms and languages (e.g. .NET, Java, Linux, Apache, Perl/Python/PHP) - Previous experience with high-scale or distributed RDBMS (Teradata, Netezza, Greenplum, Aster Data, Vertica) a plus. - Knowledge of cloud computing infrastructure (e.g. Azure, Amazon Web Services EC2, Elastic MapReduce) and considerations for scalable, distributed systems a plus

Company offers

- Creative, challenging and interesting projects
- Fast growing product
- Experienced and professional team
- Dynamic, inspiring and international environment
- Creative approach - we don’t believe in “one size fits all”
- Informal style of leadership and communication
- Fun things: leisure zone, breakfast services, snacks in the office, lot of team building events and others
- A lot of servers, complex infrastructure and challenging product
- Best workstation and tools to work with
- Possibilities to learn (conferences, trainings) and work with experts from different countries (offices around the world)
- Possibilities to make us better