AWS Kinesis Firehose: Apache Log to JSON
-
Updated
Jun 11, 2019 - JavaScript
AWS Kinesis Firehose: Apache Log to JSON
Scrapped tweets using twitter API (for keyword ‘Netflix’) on an AWS EC2 instance, ingested data into S3 via kinesis firehose. Used Spark ML on databricks to build a pipeline for sentiment classification model and Athena & QuickSight to build a dashboard
Cloud Development Kit (AWS CDK) using TypeScript, Python and Java
AWS kinesis data stream, kinesis data firehose, a transformer with lambda and store into s3 bucket
A complete AWS pipeline that collects, compiles, preprocesses streaming data and trains an ML model
Machine Learning Engineer - MLOps!
Streaming data-pipeline in aws
Recover AWS Kinesis Firehose errors by running the COPY command to each of the manifests file in the S3 errors folders
Streaming data pipeline to continuously load data from an Amazon MSK or MSK Serverless cluster to Amazon S3 using Amazon Kinesis Data Firehose.
Automated Functional Testing (AFT) packages supporting nodejs based Functional Testing
Big Data Lab | Stream Delivery AWS Kinesis Firehose
This Big Data project consists of obtaining data on vehicle theft in the city of São Paulo and consolidating it in a counting and heat map, in order to show areas with a higher index of this type of crime. All applicable in AWS Resources.
Big data Text Classification: 4M records
A simple, practical, and affordable system for measuring head trauma within the sports environment, subject to the absence of trained medical personnel made using Amazon Kinesis Data Streams, Kinesis Data Analytics, Kinesis Data Firehose, and AWS Lambda
Realtime data pipeline
This project is about building a serverless ETL pipeline using open-meteo weather API.
Streaming data pipeline on aws, Tech session repository for hist
Subscribing to CloudWatch Logs with various destinations
Let's analyze twitter sentiments.This project uses Twitter API and AWS kinesis,AWS kinesis Firehose,Comprehend,Lambda,S3 and DynamoDB
Collect, process, and analyze log data using Amazon Kinesis and Elasticsearch Service
Add a description, image, and links to the aws-kinesis-firehose topic page so that developers can more easily learn about it.
To associate your repository with the aws-kinesis-firehose topic, visit your repo's landing page and select "manage topics."