KAFKA

Creating a high available multi-region datalake with 2 Oracle databases and 2 replicated object storage buckets for purposes such as reporting, ML or AI | Part two (final)

IT by javier mugueta3 June, 20218 June, 2021

Creating a high available multi-region datalake with 2 Oracle databases and 2 replicated object storage buckets for purposes such as reporting, ML or AI | PART ONE

IT by javier mugueta27 May, 20213 June, 2021

Oracle Integration Cloud August 2020 new features: Accelerators, Recipes and Couple of Brand new Adapters, and more..

IT by javier mugueta8 September, 20208 September, 2020

{Wide Adopted Industry Data Model} + {API first} + {Event Driven Architecture} = Extensible, Efficient and Portable SaaS

IT by javier mugueta11 March, 202022 April, 2020

Near Real Time Data Driven SaaS Integration with Streaming | Part 2: Extracting/Publishing Data Changes to Streaming Topics

IT by javier mugueta13 September, 20191 May, 2020

Near Real Time Data Driven SaaS Integration with Streaming | Part 1: Overview

IT by javier mugueta30 August, 20191 May, 2020

IT by javier mugueta26 February, 201927 February, 2019

Building Producer and Consumer Clients in go Language for Oracle Event Hub Cloud Service

CREATE AN OEH CLUSTER Documentation here or watch following video: When the cluster is created, go to details page and grab the connection url, which has the format <broker1_ip>:6667,…,<brokern_ip>:6667 CREATE A TOPIC INSTALL THE LIB I’ve done the following (Mac): git clone https://github.com/edenhill/librdkafka.git cd librdkafka ./configure –prefix /usr/local make sudo make install (sudo make uninstall […]

IT by javier mugueta14 February, 201914 February, 2019

jMeter Test Script for Kafka (tested against Oracle Event Hub Cloud Service)

In this post we are testing a jMeter script that sends messages to Kafka Cluster running in Oracle Event Hub (OEH). jMETER CONFIG Install plugins manager in JMeter if you don’t have it, restart jMeter and then install Kafka Support, then you will be told to restart jMeter. jMETER SCRIPT Download the jMeter script from […]

IT by javier mugueta22 January, 201923 January, 2019

Creating a Fast&Simple Container for Sending Messages to a Topic in Oracle Event Hub Cloud Service (aka OEHCS, which is a Kafka cluster) and Deploying it to Kubernetes Cluster

The container uses 4 environment variables, you can find a container already built for you here SOURCE CODE OF THE PRODUCER var sleep = require(‘system-sleep’); const oehcs_connect_url = process.env.OEHCS_CONNECTURL const topic_name = process.env.TOPIC_NAME const num_partitions = process.env.NUM_PARTITIONS const message = process.env.MESSAGE var kafka = require(‘kafka-node’), HighLevelProducer = kafka.HighLevelProducer, client = new kafka.KafkaClient({kafkaHost: oehcs_connect_url}), producer = new […]