Thursday, December 8, 2016

Big Data

Install Hadoop "hadoop-2.7.3" on Windows 10

http://www.ics.uci.edu/~shantas/Install_Hadoop-2.6.0_on_Windows10.pdf
https://wiki.apache.org/hadoop/Hadoop2OnWindows
http://www.srccodes.com/p/article/45/run-hadoop-wordcount-mapreduce-example-windows
http://toodey.com/2015/08/10/hadoop-installation-on-windows-without-cygwin-in-10-mints/
Get Windows10 binaries to put in /bin : https://github.com/sardetushar/hadooponwindows/

Verify Installation: 
Resource Manager and Node Manager at http://localhost:8042 and 
Namenode at http://localhost:50070

The Hadoop Ecosystem
https://hadoopecosystemtable.github.io/

Hive, Pig, Spark.

<>
http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_Installing_HDP_AMB/content/_set_up_password-less_ssh.html

CaseStudy
http://hortonworks.com/blog/spark-data-science-case-study/

...The Ultimate Marketing Machine...
http://www.sas.com/content/dam/SAS/en_us/doc/whitepaper2/hbr-ultimate-marketing-machine-107261.pdf

IoT Analytics in Practice
http://docs.media.bitpipe.com/io_13x/io_130443/item_1306139/iot-analytics-in-practice-107941.pdf

HBase bulk load:-  (Start in order and pay attention to the details one by one)
1) HBase bulk load architecture - 
        https://hbase.apache.org/book.html#arch.bulk.load
2) Writing HFiles Directly During Bulk Import -
        https://hbase.apache.org/book.html#_writing_hfiles_directly_during_bulk_import
3) Spark bulk load - 
        https://hbase.apache.org/book.html#_bulk_load


Thursday, December 1, 2016

Top skills for technical pros


Top skills for technical pros

1. Big picture thinking. How can technical experts move beyond detailed, analytical thinking to thinking strategically about the "big picture?" How can they learn to see the forest and the trees? A leader needs to think strategically to set a clear vision, to build and inspire a high performance team and to establish a path forward in the face of incomplete information, limited resources or other challenges.

2. People skills. Technical experts are masters of facts, data management and control processes. But to advance as leaders, they must develop the skills to work with and through others. Leaders must inspire their teams, manage conflict and give feedback in ways that encourage others to progress rapidly toward shared goals. By understanding how their teams view the world, effective leaders can have expanded knowledge resources available when making decisions and taking action. Leaders learn quickly that interpersonal dynamics are central to the mission.

3. Flexible and integrative leadership. Flexible leaders know when to use technical and analytic problem solving and when to be conceptual and creative. They integrate multiple perspectives and have a range of problem solving and management approaches. Flexible leaders have their core leadership style, but also have the awareness and skills to adapt that style when needed to achieve results.

4. Effective communication. Engineering, science and technology professionals are proficient in the technical language of their fields. In that domain, credibility and influence come from communication with colleagues who respect their expertise, but leaders must communicate with diverse stakeholders and compete for resources in the face of multiple priorities. Technology professionals who aspire to leadership positions must become skilled at influencing business leaders, building partnerships across functional areas and working effectively with multidisciplinary teams. Clear, persuasive communication tailored to different audiences is key to maximizing opportunities and achieving results with and through others.

detailed @ techtarget.com

http://www.businessinsider.in/This-unknown-Google-exec-fought-a-brutal-internal-battle-and-now-controls-a-60-billion-business/articleshow/46831604.cms