George Jen, Jen Tek LLC

Introduction

We want to build a custom docker image that includes everything a data engineering developer would need:

CentOS 8 image
Python3
Java Development Toolkit 1.8
Jupyter-notebook server to run Python from the host
ssh-server for the ease of connecting to the container using ssh and scp, as…


Surprisingly good Moon photo with low cost old manual lens Canon DSLR camera body

Today is Chinese mid autumn day, also known as moon festival, on that day, the shape of the moon is fullest during the year.

I want to take photo shot at the moon, but I only…


George Jen, Jen Tek LLC

Abstract

Apache Spark natively includes library for Graph computing called Graphx, a distributed graph processing framework. It is based on the Spark platform and provides a simple, easy-to-use and rich interface for graph computing and graph mining, which greatly facilitates the demand for distributed graph processing.


George Jen, Jen Tek LLC

Summary

This tutorial covers integration between Spark SQL and Cassandra and coding in Scala and Python with Spark SQL against table in Cassandra NoSQL database. …


Create 3 node Hadoop and Spark Cluster Monitored by SignalFx from Splunk

George Jen, Jen Tek LLC

Summary

This writing provides step by step instructions to create 3 node Hadoop, Hive and 3 node Spark cluster in both Standalone mode and managed by yarn from Hadoop as well as how to…


George Jen, Jen Tek LLC

I need to test our application on a database service that can be auto-scaled. Try snowflake, so sign up one.

My usage is to simply let Scala code to access to Snowflake, with only an assistance of a JDBC driver.

Therefore, below information is needed…


George Jen, Jen Tek LLC

This tutorial is for developers or learners who are new to Scala as a programming language and want to get familiar with processes of Scala development build and QA unit testing. If this is of interest to you, read on.

Pre-requisite are JDK, Scala compiler…

George Jen

I am founder of Jen Tek LLC, a startup company in East Bay California developing AI powered, cloud based documentation/publishing software as a service.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store