I need a really good colleague who can work with me like Data Engineer, if you have the right attitude and skills then this will be your dream job.
So what are we doing?
We are working with a lot of open source components, Nginx, spark,Hadoop, nifi, flink, kafka, elasticsearch, grafana, git, Jenkins, docker
We are developing code in java, python, groovy, shell, scala
We are integrating with as many of the banks core systems as we can
We are loading data from oracle, DW, facebook, internet bank logs, loan systems, network
We are analyzing the data
We are playing with machine learning and discussing AI as ways of analyzing data.