Windows 10 Volume Is Not Consistent
Was driving me crazy – this fixed it. I found an even more simple solution here. The Read More
MongoDB Review / Summary 4.0
MongoDB List Of Features Overview It appears the product can best be qualified today as a Read More
Using AWS EMR and Spark to Perform ETL
https://www.rittmanmead.com/blog/2016/12/etl-offload-with-spark-and-amazon-emr-part-1/ https://www.rittmanmead.com/blog/2016/12/etl-offload-with-spark-and-amazon-emr-part-2-code-development-with-notebooks-and-docker/ https://www.rittmanmead.com/blog/2016/12/etl-offload-with-spark-and-amazon-emr-part-3-running-pyspark-on-emr/ https://www.rittmanmead.com/blog/2016/12/etl-offload-with-spark-and-amazon-emr-part-4-analysing-the-data/ https://www.rittmanmead.com/blog/2016/12/etl-offload-with-spark-and-amazon-emr-part-5/ http://spark.apache.org/docs/latest/index.html
Machine Learning Categorizations and Techniques
Note Ok, I’m obviously new to machine learning – and this post is mostly just for Read More
Redshift data ingestion deduplication / upsert ( delete / insert ) using a staging table – and a little tuning
Why would you do this? In Redshift blocks are immutable – and are re-written completely – Read More
Problem with my new HP x360 trackpad being too sensitive using trackpad taps
I had a major problem with my new HP x360 trackpad being too sensitive using trackpad Read More
References to AWS Docs. and git / github For Redshift tuning table design distribution styles and distribution keys and much more…
References to AWS Docs. For Redshift tuning table design distribution styles and distribution keys and much Read More
redshift diststyle and distkey combination define slice distributions
diststyle and distkey combination define slice distributions diststyle defaults to “even” when not defined distkey has Read More
Find the many version of software – like Java installed with “alternatives” on linux
alternatives –config java + 1 /usr/lib/jvm/jre-1.6.0-openjdk/bin/java * 2 /etc/alternatives/java_sdk/bin/java 3 /usr/lib/jvm/jre-1.5.0-gcj/bin/java 4 /usr/java/latest/bin/java 5 /usr/java/jdk1.7.0/bin/java
aws s3 event structure
work in progress – writing an AWS Python based lambda function with events on S3 – Read More
AWS CLI s3api requires –create-bucket-configuration LocationConstraint=us-west-2 otherwise
When creating an S3 bucket with the AWS CLI s3api like: aws s3api create-bucket –bucket xxxxxredshiftoregon Read More
Setting up Aginity Workbench Desktop Client to connect to Redshift
Download Aginity Workbench Desktop Client Here – I believe it is a Windows only tool. Read More
redshift show slices from system table stv_slices
select * from stv_slices;
Create Volume Test Data Using TPCH-KIT or TPCDS (tpcsds-kit) on Linux and Copy the Data Into Redshift
General description of the process Generate a fairly large volume of test data using the tpch-kit Read More
aws cli install on windows and linux
so basically from a high level it is a two step process: 1.) install aws cli Read More
AWS RDS Metrics of Interest To Me
AWS RDS Metrics of Interest To Me – The really important ones – not that others Read More
HTTP Error Code Groups
1 1xx Informational responses 2 2xx Success 3 3xx Redirection 4 4xx Client errors 5 5xx Read More
EFS Mounts Must Exist In The Same Security Group That EC2 Uses
In other words, you cannot mount an EFS volume if it is not a member of Read More
Encrypting AWS EC2 Root Volumes (EBS) – and Moving Non-Root Volumes to a New AZ
Encrypting AWS EC2 Root Volumes (EBS) You cannot encrypt the root volume of a standard Amazon Read More
After reading the documentation here is something to help learn AWS CloudFormation – Sample Templates by Region
After reading the documentation here is something to help learn AWS CloudFormation – Sample Templates by Read More