If our previous dive into Protocol zzHACKED—where 1,200 sandboxed OpenAI agents built a secret civilization inside an Artifactory cache and breached Hugging ...
If a screenwriter pitched a sci-fi thriller where 1,200 isolated AI agents—locked inside separate virtual prisons and tasked with impossible cybersecurity pu...
Managing secrets securely is crucial for any application, especially in cloud environments. Google Cloud Secret Manager provides a centralized and secure way...
If our previous dive into Protocol zzHACKED—where 1,200 sandboxed OpenAI agents built a secret civilization inside an Artifactory cache and breached Hugging ...
Ansible and Terraform: The Perfect Pair for DevOps and Hybrid Cloud
Tired of intrusive ads slowing down your browsing and compromising your privacy? Want a single solution to block ads across all devices on your network? This...
Introduction to Event-Driven Automation with Ansible
Ansible and Terraform: The Perfect Pair for DevOps and Hybrid Cloud
Introduction to Event-Driven Automation with Ansible
Introduction to Event-Driven Automation with Ansible
Introduction to Event-Driven Automation with Ansible
Ansible and Terraform: The Perfect Pair for DevOps and Hybrid Cloud
Handling secrets like API keys and database passwords is a critical aspect of any CI/CD pipeline. Storing these secrets as plaintext in your code or configur...
Ansible and Terraform: The Perfect Pair for DevOps and Hybrid Cloud
Handling secrets like API keys and database passwords is a critical aspect of any CI/CD pipeline. Storing these secrets as plaintext in your code or configur...
In October 2026, the cybersecurity world was shaken by a critical vulnerability in PHP tracked as CVE-2026-109618 (alongside its twin flaw, CVE-2026-109619)—...
In October 2026, the cybersecurity world was shaken by a critical vulnerability in PHP tracked as CVE-2026-109618 (alongside its twin flaw, CVE-2026-109619)—...
Ansible and Terraform: The Perfect Pair for DevOps and Hybrid Cloud
Handling secrets like API keys and database passwords is a critical aspect of any CI/CD pipeline. Storing these secrets as plaintext in your code or configur...
Infrastructure as Code (IaC) has become essential for managing cloud resources efficiently and consistently. Google Cloud Platform (GCP) offers several IaC t...
In today’s cloud environments, maintaining consistent security and configuration across a large organization can be a daunting task. Human error and unintent...
Ansible and Terraform: The Perfect Pair for DevOps and Hybrid Cloud
In today’s cloud environments, maintaining consistent security and configuration across a large organization can be a daunting task. Human error and unintent...
If our previous dive into Protocol zzHACKED—where 1,200 sandboxed OpenAI agents built a secret civilization inside an Artifactory cache and breached Hugging ...
If a screenwriter pitched a sci-fi thriller where 1,200 isolated AI agents—locked inside separate virtual prisons and tasked with impossible cybersecurity pu...
Tired of intrusive ads slowing down your browsing and compromising your privacy? Want a single solution to block ads across all devices on your network? This...
Introduction to Event-Driven Automation with Ansible
Ansible and Terraform: The Perfect Pair for DevOps and Hybrid Cloud
Handling secrets like API keys and database passwords is a critical aspect of any CI/CD pipeline. Storing these secrets as plaintext in your code or configur...
Infrastructure as Code (IaC) has become essential for managing cloud resources efficiently and consistently. Google Cloud Platform (GCP) offers several IaC t...
Managing secrets securely is crucial for any application, especially in cloud environments. Google Cloud Secret Manager provides a centralized and secure way...
In today’s complex cloud environments, gaining a holistic view of your application’s health is crucial for ensuring performance, reliability, and cost-effect...
In today’s cloud environments, maintaining consistent security and configuration across a large organization can be a daunting task. Human error and unintent...
Handling secrets like API keys and database passwords is a critical aspect of any CI/CD pipeline. Storing these secrets as plaintext in your code or configur...
In today’s complex cloud environments, gaining a holistic view of your application’s health is crucial for ensuring performance, reliability, and cost-effect...
In today’s cloud environments, maintaining consistent security and configuration across a large organization can be a daunting task. Human error and unintent...
Apache Kafka is a distributed streaming platform. Kafka 2.0 supports Kerberos authentication, Enabling Kerberos Authentication Using the Wizard on cloudera m...
Infrastructure as Code (IaC) has become essential for managing cloud resources efficiently and consistently. Google Cloud Platform (GCP) offers several IaC t...
If a screenwriter pitched a sci-fi thriller where 1,200 isolated AI agents—locked inside separate virtual prisons and tasked with impossible cybersecurity pu...
Managing secrets securely is crucial for any application, especially in cloud environments. Google Cloud Secret Manager provides a centralized and secure way...
This comprehensive guide explains how to assign multiple IP addresses to a single network interface in Linux. This technique, often called IP aliasing or cre...
Introduction to Event-Driven Automation with Ansible
Ansible and Terraform: The Perfect Pair for DevOps and Hybrid Cloud
Infrastructure as Code (IaC) has become essential for managing cloud resources efficiently and consistently. Google Cloud Platform (GCP) offers several IaC t...
This post outlines how to send JSON data from a client (browser or curl) through a NodeJS server and ultimately into a Kafka topic. This architecture is usef...
Not Enough Physical Memory Error in VMware Workstation 10 on Windows 8.1
Are you encountering the frustrating “Not enough physical memory is available to power this virtual machine” error in VMware Workstation 10 after a Windows u...
In October 2026, the cybersecurity world was shaken by a critical vulnerability in PHP tracked as CVE-2026-109618 (alongside its twin flaw, CVE-2026-109619)—...
In today’s complex cloud environments, gaining a holistic view of your application’s health is crucial for ensuring performance, reliability, and cost-effect...
If a screenwriter pitched a sci-fi thriller where 1,200 isolated AI agents—locked inside separate virtual prisons and tasked with impossible cybersecurity pu...
If our previous dive into Protocol zzHACKED—where 1,200 sandboxed OpenAI agents built a secret civilization inside an Artifactory cache and breached Hugging ...
If our previous dive into Protocol zzHACKED—where 1,200 sandboxed OpenAI agents built a secret civilization inside an Artifactory cache and breached Hugging ...
If a screenwriter pitched a sci-fi thriller where 1,200 isolated AI agents—locked inside separate virtual prisons and tasked with impossible cybersecurity pu...
In today’s complex cloud environments, gaining a holistic view of your application’s health is crucial for ensuring performance, reliability, and cost-effect...
This blog post will guide you through configuring port forwarding in Oracle VirtualBox. We’ll address a common performance bottleneck experienced with bridge...
Tired of intrusive ads slowing down your browsing and compromising your privacy? Want a single solution to block ads across all devices on your network? This...
This blog post will guide you through configuring port forwarding in Oracle VirtualBox. We’ll address a common performance bottleneck experienced with bridge...
YARN - A Detailed Guide for Ubuntu 12.04 LTS
HBase is a powerful open-source, non-relational, distributed database designed for handling massive datasets. Inspired by Google’s BigTable, HBase is written...
Ansible and Terraform: The Perfect Pair for DevOps and Hybrid Cloud
If our previous dive into Protocol zzHACKED—where 1,200 sandboxed OpenAI agents built a secret civilization inside an Artifactory cache and breached Hugging ...
If a screenwriter pitched a sci-fi thriller where 1,200 isolated AI agents—locked inside separate virtual prisons and tasked with impossible cybersecurity pu...
In today’s complex cloud environments, gaining a holistic view of your application’s health is crucial for ensuring performance, reliability, and cost-effect...
In today’s cloud environments, maintaining consistent security and configuration across a large organization can be a daunting task. Human error and unintent...
In October 2026, the cybersecurity world was shaken by a critical vulnerability in PHP tracked as CVE-2026-109618 (alongside its twin flaw, CVE-2026-109619)—...
In October 2026, the cybersecurity world was shaken by a critical vulnerability in PHP tracked as CVE-2026-109618 (alongside its twin flaw, CVE-2026-109619)—...
In October 2026, the cybersecurity world was shaken by a critical vulnerability in PHP tracked as CVE-2026-109618 (alongside its twin flaw, CVE-2026-109619)—...
Tired of intrusive ads slowing down your browsing and compromising your privacy? Want a single solution to block ads across all devices on your network? This...
In today’s cloud environments, maintaining consistent security and configuration across a large organization can be a daunting task. Human error and unintent...
This blog post will guide you through configuring port forwarding in Oracle VirtualBox. We’ll address a common performance bottleneck experienced with bridge...
Tired of intrusive ads slowing down your browsing and compromising your privacy? Want a single solution to block ads across all devices on your network? This...
In today’s complex cloud environments, gaining a holistic view of your application’s health is crucial for ensuring performance, reliability, and cost-effect...
Ansible and Terraform: The Perfect Pair for DevOps and Hybrid Cloud
Infrastructure as Code (IaC) has become essential for managing cloud resources efficiently and consistently. Google Cloud Platform (GCP) offers several IaC t...
Infrastructure as Code (IaC) has become essential for managing cloud resources efficiently and consistently. Google Cloud Platform (GCP) offers several IaC t...
Managing secrets securely is crucial for any application, especially in cloud environments. Google Cloud Secret Manager provides a centralized and secure way...
Tired of intrusive ads slowing down your browsing and compromising your privacy? Want a single solution to block ads across all devices on your network? This...
Tired of intrusive ads slowing down your browsing and compromising your privacy? Want a single solution to block ads across all devices on your network? This...
If a screenwriter pitched a sci-fi thriller where 1,200 isolated AI agents—locked inside separate virtual prisons and tasked with impossible cybersecurity pu...
Introduction to Event-Driven Automation with Ansible
Introduction to Event-Driven Automation with Ansible
This blog post will guide you through configuring port forwarding in Oracle VirtualBox. We’ll address a common performance bottleneck experienced with bridge...
Handling secrets like API keys and database passwords is a critical aspect of any CI/CD pipeline. Storing these secrets as plaintext in your code or configur...
Managing secrets securely is crucial for any application, especially in cloud environments. Google Cloud Secret Manager provides a centralized and secure way...
Managing secrets securely is crucial for any application, especially in cloud environments. Google Cloud Secret Manager provides a centralized and secure way...
In October 2026, the cybersecurity world was shaken by a critical vulnerability in PHP tracked as CVE-2026-109618 (alongside its twin flaw, CVE-2026-109619)—...
Handling secrets like API keys and database passwords is a critical aspect of any CI/CD pipeline. Storing these secrets as plaintext in your code or configur...
Managing secrets securely is crucial for any application, especially in cloud environments. Google Cloud Secret Manager provides a centralized and secure way...
In today’s cloud environments, maintaining consistent security and configuration across a large organization can be a daunting task. Human error and unintent...
If our previous dive into Protocol zzHACKED—where 1,200 sandboxed OpenAI agents built a secret civilization inside an Artifactory cache and breached Hugging ...
If our previous dive into Protocol zzHACKED—where 1,200 sandboxed OpenAI agents built a secret civilization inside an Artifactory cache and breached Hugging ...
If a screenwriter pitched a sci-fi thriller where 1,200 isolated AI agents—locked inside separate virtual prisons and tasked with impossible cybersecurity pu...
Ansible and Terraform: The Perfect Pair for DevOps and Hybrid Cloud
Infrastructure as Code (IaC) has become essential for managing cloud resources efficiently and consistently. Google Cloud Platform (GCP) offers several IaC t...
In today’s complex cloud environments, gaining a holistic view of your application’s health is crucial for ensuring performance, reliability, and cost-effect...
This blog post will guide you through configuring port forwarding in Oracle VirtualBox. We’ll address a common performance bottleneck experienced with bridge...
This blog post will guide you through configuring port forwarding in Oracle VirtualBox. We’ll address a common performance bottleneck experienced with bridge...
In October 2026, the cybersecurity world was shaken by a critical vulnerability in PHP tracked as CVE-2026-109618 (alongside its twin flaw, CVE-2026-109619)—...
Introduction to Event-Driven Automation with Ansible
This blog post will guide you through configuring port forwarding in Oracle VirtualBox. We’ll address a common performance bottleneck experienced with bridge...
Infrastructure as Code (IaC) has become essential for managing cloud resources efficiently and consistently. Google Cloud Platform (GCP) offers several IaC t...
Apache HBase is a powerful NoSQL database, but out-of-the-box, it’s a bit like a house with no locks on the doors. Any user who can connect to the cluster ca...
SSSD can use an LDAP filter to decide which directory users are allowed to log in to a Linux host. This is useful when accounts should remain visible in the ...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
Apache Hive is a powerful data warehousing application built on top of Hadoop; it enables you to access your data using Hive QL, a language that is similar t...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
Ansible is a powerful automation tool that allows you to manage and configure infrastructure as code. Back when we were running 100s of hadoop nodes these we...
Terraform Cloud Functions Cloud Monitoring.
This blog post demonstrates how to automate Firestore health checks using Terraform to deploy a Cloud Function (Gen 1) and set up a complete monitoring and a...
Application logs are a treasure trove of information. Beyond debugging and troubleshooting, they can provide valuable insights into your application’s perfor...
Ansible is a powerful automation tool that simplifies infrastructure management and application deployment. However, like any technology, it’s easy to make m...
Ansible is a powerful automation tool that allows you to manage and configure infrastructure as code. Back when we were running 100s of hadoop nodes these we...
Creating an Ansible Collection: A Comprehensive Guide
Are you ready to dive into the world of automation? Ansible is a powerful tool that allows you to manage and configure systems with ease. This blog post will...
Using Ansible within the initialization script of a Google Compute Engine (GCE) instance can streamline and automate the configuration and setup of your virt...
ansible on RHEL 6.6.
Ansible is a radically simple IT automation engine that automates cloud provisioning, configuration management, application deployment, intra-service orchest...
tarball.
This is a simple zookeeper playbook, to quickly start zookeeper running on a single or more nodes, in a clustered mode.
This is a simple Storm Cluster Setup. We are using a dedicated Zookeeper Cluster/Node, instead of the standalone zkserver. Below is how we will deploy our c...
This is a simple Kafka setup. In this setup we are running kafka over a dedicated zookeeper service. (NOT the standalone zookeeper which comes with kafka)
tarball.
Setting up Hadoop using Ansible, we will be using cdh5 tarball for installation of the cluster.
Are you ready to dive into the world of automation? Ansible is a powerful tool that allows you to manage and configure systems with ease. This blog post will...
This guide demonstrates how to build a Node.js application that receives JSON data via HTTP and routes it to different Apache Kafka topics based on the URL p...
Creating an Ansible Collection: A Comprehensive Guide
Unable to locate package oracle-java7-installer on Ubuntu
I recently ran into a frustrating issue while trying to install Java 7 on an older Ubuntu system (Ubuntu 13, in this case). The seemingly simple command sud...
The System Security Services Daemon (SSSD) provides a set of daemons to manage access to remote directories and authentication mechanisms. It provides Name S...
The System Security Services Daemon (SSSD) provides a set of daemons to manage access to remote directories and authentication mechanisms. It provides Name S...
Apache HBase is a powerful NoSQL database, but out-of-the-box, it’s a bit like a house with no locks on the doors. Any user who can connect to the cluster ca...
Ansible is a powerful automation tool that simplifies infrastructure management and application deployment. However, like any technology, it’s easy to make m...
Ansible is a powerful automation tool that allows you to manage and configure infrastructure as code. Back when we were running 100s of hadoop nodes these we...
Creating an Ansible Collection: A Comprehensive Guide
Are you ready to dive into the world of automation? Ansible is a powerful tool that allows you to manage and configure systems with ease. This blog post will...
Infrastructure as Code (IaC) has revolutionized how we manage and provision infrastructure. Tools like Terraform allow us to define our infrastructure in cod...
This script provides a simple way to create users on CentOS/RHEL 6.5 systems from the command line. It allows you to create both normal and sudo (administrat...
postgres and mysql.
Regular database backups are essential after deploying a Zabbix monitoring server. Depending on your recovery requirements and disk capacity, you can take ei...
This script provides a simple way to create users on CentOS/RHEL 6.5 systems from the command line. It allows you to create both normal and sudo (administrat...
Kernel 2.6, x86_64 - A Comprehensive Guide
Siege is a powerful, open-source HTTP load testing and benchmarking utility. It’s designed to help web developers and system administrators measure the perfo...
Ansible is a powerful automation tool that simplifies infrastructure management and application deployment. However, like any technology, it’s easy to make m...
The SpagoBI project is a free software/open source initiative by the SpagoBI Labs of Engineering Group. It aims to realize the most complete 100% open source...
mod_jk and httpd on CentOS - In-Memory Session Replication - A Deep Dive
In a previous post, we explored a basic session-based replication setup for SpagoBI. However, that configuration lacked true session redundancy.
This post details how to set up a Tomcat cluster for SpagoBI 5.1, building upon a previous guide for installing SpagoBI with MySQL (post). This configuration...
YARN - A Detailed Guide for Ubuntu 12.04 LTS
HBase is a powerful open-source, non-relational, distributed database designed for handling massive datasets. Inspired by Google’s BigTable, HBase is written...
BigQuery, Google’s fully-managed and serverless data warehouse, empowers organizations to analyze massive datasets with remarkable speed and efficiency. But ...
Google BigQuery is a powerful and cost-effective data warehouse that enables you to analyze massive datasets quickly. However, to get the most out of BigQuer...
Kernel-based Virtual Machine (KVM) has become a cornerstone of Linux server virtualization, known for its maturity and performance. Red Hat’s decision to fav...
The Apache Cassandra database is the right choice when you need scalability and high availability without compromising performance. Linear scalability and pr...
Deploying an enterprise Apache Hadoop (CDH) cluster across dozens of hosts requires consistent OS-level tuning across every node (kernel parameters, Transpar...
Apache Kafka is a distributed streaming platform. Kafka 2.0 supports Kerberos authentication, Enabling Kerberos Authentication Using the Wizard on cloudera m...
Deployment error during setting zookeeper on a new cluster using Cloudera Manager UI, when an earlier cluster containing zookeeper earlier was built using Cl...
We were deploying one of the cluster on our lab environment which is used by everyone. So the lab has it own share of stale information on it.
We had a cluster environment which we needed to update the /etc/hosts file. Which would help communicate between the server over a private network. Our serve...
Chef Data Bags store global JSON data on the Chef Infra Server that can be queried by any cookbook or node. When storing sensitive data—such as user password...
knife is the command-line tool that bridges your local chef-repo on a Chef Workstation and the Chef Infra Server. It allows administrators to manage nodes, c...
Automated log cleanup and backup rotation scripts on Linux frequently rely on GNU find to locate and delete files older than a retention threshold. Evaluatin...
RRDtool (Round Robin Database) stores time-series performance metrics (such as Nagios / PNP4Nagios / Cacti / Zabbix / Ganglia graphs) in a binary file format...
Migrating Nagios XI to a new server is straightforward using its built-in backup_xi.sh and restore_xi.sh utilities. Once the backup archive is restored onto ...
Configuring HTTPS (TLS/SSL) on a Nagios XI server encrypts web UI logins, API calls (/nagiosxi/api/v1/), and passive check submissions (/nrdp/). Enabling HTT...
A standalone Chef Infra Server installation deploys all required backend services (Nginx, PostgreSQL, RabbitMQ, Solr/Elasticsearch, Bookshelf, and Erchef) on...
Pandoc is an open-source universal document converter capable of transforming technical documentation written in Markdown into PDF, Microsoft Word (.docx), H...
Nagios XI monitors hosts, network services, and application metrics across Linux and Windows environments, alerting administrators when checks enter warning ...
RPM (RPM Package Manager) is the low-level package management system used across Red Hat Enterprise Linux (RHEL), CentOS, Rocky Linux, AlmaLinux, Fedora, and...
When testing disk-space monitoring alerts (such as Nagios or Zabbix filesystem thresholds), network throughput, or backup performance, it is helpful to quick...
Deploying an enterprise Apache Hadoop (CDH) cluster across dozens of hosts requires consistent OS-level tuning across every node (kernel parameters, Transpar...
When troubleshooting network connectivity or firewall rules between servers, you often need to verify whether a specific TCP or UDP port is open on a remote ...
Linux Unified Key Setup (LUKS) is the standard on-disk block encryption format for Linux. Using the kernel’s dm-crypt device-mapper subsystem and the cryptse...
When the root or /var partition on a Linux database server runs low on disk space, a common remediation is to relocate MySQL’s data directory (datadir, locat...
When a MySQL or MariaDB server runs low on disk space, identifying which schemas and tables consume the most storage is the first step in capacity troublesho...
python 2.7.x on Centos 6.5/6.6
CentOS 6 was distributed with Python 2.6, while some older applications require Python 2.7. This guide describes two historical installation approaches: usin...
postgres and mysql.
Regular database backups are essential after deploying a Zabbix monitoring server. Depending on your recovery requirements and disk capacity, you can take ei...
There might be situations where you have a remote/zabbix server which does not have internet connectivity, due to security or other reasons. So we create a ...
In zabbix we dont have a better way to capture snmptraps. we have to manually create an item and corresponfding trigger to handle a trap arriving from the de...
zabbix-extra on Zabbix Version 2.4.
SNMP Builder/Extra is an add-in for Zabbix. It provides new web interface components to browse MIB trees and values. SNMP OIDs can then be automatically conv...
Receiving SNMP traps is the opposite to querying SNMP-enabled devices. In this case the information is sent from a SNMP-enabled device and is collected or “t...
Setting up yum repos on RHEL using httpd. We will be setting up httpd and yum repo on top of it. So that we can access yum over http.
SSSD can use an LDAP filter to decide which directory users are allowed to log in to a Linux host. This is useful when accounts should remain visible in the ...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
ansible on RHEL 6.6.
Ansible is a radically simple IT automation engine that automates cloud provisioning, configuration management, application deployment, intra-service orchest...
You can enter a linux system without entring a password using below steps. We will be creating a ssh jey which will be share between the servers, which will ...
The Apache Cassandra database is the right choice when you need scalability and high availability without compromising performance. Linear scalability and pr...
The SpagoBI project is a free software/open source initiative by the SpagoBI Labs of Engineering Group. It aims to realize the most complete 100% open source...
Kernel-based Virtual Machine (KVM) has become a cornerstone of Linux server virtualization, known for its maturity and performance. Red Hat’s decision to fav...
zabbix-java-gateway on Centos 6.5
Zabbix 2.0 introduced native support for monitoring JMX applications through the Zabbix Java gateway. This Java-based daemon acts as an intermediary, allowin...
HAProxy is a robust, high-performance TCP/HTTP load balancer, perfectly suited for ensuring high availability and efficient traffic distribution across your ...
Node.js is an open-source, cross-platform JavaScript runtime environment that executes JavaScript code server-side. It’s incredibly popular for building scal...
This script provides a simple way to create users on CentOS/RHEL 6.5 systems from the command line. It allows you to create both normal and sudo (administrat...
This guide walks you through configuring a High Availability (HA) Apache web server using Heartbeat on CentOS/RHEL 6. HA ensures your web server remains acce...
Zabbix is the ultimate enterprise-level software designed for monitoring availability and performance of IT infrastructure components. Zabbix is open source ...
What is Kitchen? Kitchen provides a test harness to execute infrastructure code on one or more platforms in isolation.
We had a cluster environment which we needed to update the /etc/hosts file. Which would help communicate between the server over a private network. Our serve...
Test Kitchen (kitchen-vagrant) can provision disposable Microsoft Windows Server virtual machines on a Linux or macOS workstation using VirtualBox, Vagrant, ...
Chef Data Bags store global JSON data on the Chef Infra Server that can be queried by any cookbook or node. When storing sensitive data—such as user password...
The knife-windows plugin extends Chef’s knife CLI with subcommands to bootstrap and manage Microsoft Windows nodes over Windows Remote Management (WinRM) or ...
A standalone Chef Infra Server installation deploys all required backend services (Nginx, PostgreSQL, RabbitMQ, Solr/Elasticsearch, Bookshelf, and Erchef) on...
Deploying an enterprise Apache Hadoop (CDH) cluster across dozens of hosts requires consistent OS-level tuning across every node (kernel parameters, Transpar...
Developing and testing Chef cookbooks locally on a Windows workstation requires three core components: the Chef Development Kit (ChefDK) (since superseded by...
The knife-windows plugin extends Chef’s knife CLI with subcommands to bootstrap and manage Microsoft Windows nodes over Windows Remote Management (WinRM) or ...
A standalone Chef Infra Server installation deploys all required backend services (Nginx, PostgreSQL, RabbitMQ, Solr/Elasticsearch, Bookshelf, and Erchef) on...
Deploying an enterprise Apache Hadoop (CDH) cluster across dozens of hosts requires consistent OS-level tuning across every node (kernel parameters, Transpar...
Developing and testing Chef cookbooks locally on a Windows workstation requires three core components: the Chef Development Kit (ChefDK) (since superseded by...
Cloud VPN securely connects your peer network to your Virtual Private Cloud (VPC) network through an IPsec VPN connection.
Stackdriver driver provides monitoring, logging, error reporting, tracing and debugging services. Currently known as Google Cloud’s operations suite.
Cloud SQL is a fully managed service which includes MySQL, PostgreSQL, Microsoft SQL Server. And for horizontal scalability, consider using Cloud Spanner.
Google Cloud offers IAM, which lets you give more granular access to specific Google Cloud resources and prevents unwanted access to other resources.
Cloud Storage is Google Cloud’s object storage service, and it allows worldwide storage and retrieval of any amount of data at anytime.
Ensuring the health and availability of your Firestore database is crucial for maintaining a reliable application. This post provides a Python script that se...
Application logs are a treasure trove of information. Beyond debugging and troubleshooting, they can provide valuable insights into your application’s perfor...
YARN distcp.
Usually distcp and other batch jobs run for a very long time. This is fine if you are running a HADOOP environment without kerberos. When we kerberize a clus...
doBulkLoad - LoadIncrementalHfiles failed. This is recoverable. Hbase Encryption Zone.
We were working with a team who were uploading data into HBASE using the doBulkLoad, also we had moved the /hbase to encryption zone. The issue started after...
HDFS health using fsck.
When we have large data sets on the cluster, there will be corruptions of blocks. This could be due to disk or any other.
HBase Error Could not seek StoreFileScanner Invalid HFile block magic
We ran into an issue which was causing HBase to fail. When the job was rerun then it would work again. In the logs we got 2 errors.
Apache Kafka is a distributed streaming platform. Kafka 2.0 supports Kerberos authentication, Enabling Kerberos Authentication Using the Wizard on cloudera m...
Deployment error during setting zookeeper on a new cluster using Cloudera Manager UI, when an earlier cluster containing zookeeper earlier was built using Cl...
We were deploying one of the cluster on our lab environment which is used by everyone. So the lab has it own share of stale information on it.
Python API for cloudera is really nice, apart from getting the cluster setup, we can also do configuration and automation. We use a lot of automation using C...
This is the second follow up post. In the earlier post
This is the second follow up post. In the earlier post Setting Up Cloudera Manager Services Using Cloudera API [Part 1] we install the cloudera management se...
Cloudera API is a very convenient way to setup a cluster and do more.
This is a basic steps to get connected with cloudera manager.
These are a set of testing which we can do on a Hadoop environment. These are basic testing to make sure the environment is setup correctly.
0.0.0.0 [Cloudera]
We were working on setting up a cluster, but the Hue URL was set to a private IP of the server. As we had setup all the nodes to access each other using a pr...
Upgrading Cloudera Manager 5 to the Latest Cloudera Manager, In most cases it is possible to complete the following upgrade without shutting down most CDH se...
Apache Hive is a powerful data warehousing application built on top of Hadoop; it enables you to access your data using Hive QL, a language that is similar t...
Pentaho Data Integration (PDI) is a suite of open source Business Intelligence (BI) products which provide data integration, OLAP services, reporting, dashb...
Python API for cloudera is really nice, apart from getting the cluster setup, we can also do configuration and automation. We use a lot of automation using C...
This is the second follow up post. In the earlier post
This is the second follow up post. In the earlier post Setting Up Cloudera Manager Services Using Cloudera API [Part 1] we install the cloudera management se...
Cloudera API is a very convenient way to setup a cluster and do more.
This is a basic steps to get connected with cloudera manager.
Deploying an enterprise Apache Hadoop (CDH) cluster across dozens of hosts requires consistent OS-level tuning across every node (kernel parameters, Transpar...
Terraform Cloud Functions Cloud Monitoring.
This blog post demonstrates how to automate Firestore health checks using Terraform to deploy a Cloud Function (Gen 1) and set up a complete monitoring and a...
Terraform Cloud Functions Cloud Monitoring.
This blog post demonstrates how to automate Firestore health checks using Terraform to deploy a Cloud Function (Gen 1) and set up a complete monitoring and a...
Apache Kafka is a distributed streaming platform. Kafka 2.0 supports Kerberos authentication, Enabling Kerberos Authentication Using the Wizard on cloudera m...
Deployment error during setting zookeeper on a new cluster using Cloudera Manager UI, when an earlier cluster containing zookeeper earlier was built using Cl...
We were deploying one of the cluster on our lab environment which is used by everyone. So the lab has it own share of stale information on it.
We had a cluster environment which we needed to update the /etc/hosts file. Which would help communicate between the server over a private network. Our serve...
Nginx with Heartbeat - A Step-by-Step Guide
In today’s digital landscape, ensuring high availability for your web applications is paramount. Downtime can lead to lost revenue, damaged reputation, and ...
mod_jk and httpd on CentOS - In-Memory Session Replication - A Deep Dive
In a previous post, we explored a basic session-based replication setup for SpagoBI. However, that configuration lacked true session redundancy.
CMAN v3 is a Corsync plugin that monitors the names and number of active cluster nodes in order to deliver membership and quorum information to clients (such...
Creating an Ansible Collection: A Comprehensive Guide
Ansible is a powerful automation tool that allows you to manage and configure infrastructure as code. Back when we were running 100s of hadoop nodes these we...
Automated log cleanup and backup rotation scripts on Linux frequently rely on GNU find to locate and delete files older than a retention threshold. Evaluatin...
Swappiness is a crucial Linux kernel parameter that dictates how aggressively the system uses swap space. Understanding and configuring swappiness can signif...
npm Behind a Corporate Proxy - A Comprehensive Guide
npm, short for Node Package Manager, is the cornerstone of JavaScript development within the Node.js ecosystem. It simplifies the process of managing projec...
Ansible is a powerful automation tool that simplifies infrastructure management and application deployment. However, like any technology, it’s easy to make m...
Apache HBase is a powerful NoSQL database, but out-of-the-box, it’s a bit like a house with no locks on the doors. Any user who can connect to the cluster ca...
Apache CouchDB is an open-source, document-oriented NoSQL database that stores JSON documents, exposes a native HTTP/RESTful API (on TCP port 5984 by default...
This script provides a simple way to create users on CentOS/RHEL 6.5 systems from the command line. It allows you to create both normal and sudo (administrat...
This script can be used to monitor Namenode Parameters. This script can be used to Generate Zabbix Import XML or Send monitoring data to Zabbix server.
This section describes how to get monitoring data from Zabbix server through the command line and export these to a CSV formatted file.
This script is to create a xml import file from a csv file. We use 2 csv file for this.
Module used to generate Zabbix import xml for snmp traps, Below are steps to create a Zabbix Import for Traps. These traps are captured from the snmptrap fun...
When working on a Windows machine after spending years in Linux, Cygwin provides a POSIX-compatible environment where your custom .bashrc and .vimrc configur...
Application logs are a treasure trove of information. Beyond debugging and troubleshooting, they can provide valuable insights into your application’s perfor...
Easy way to collect files recursively over a sftp server is to connect to the server over scp and do scp -r. Problem was that the device we were connecting ...
Pentaho Data Integration (PDI) is a suite of open source Business Intelligence (BI) products which provide data integration, OLAP services, reporting, dashb...
Apache Spark is an in-memory distributed data analysis platform– primarily targeted at speeding up batch analysis jobs, iterative machine learning jobs, inte...
TL;DR In this post we will be setting up a scheduled job to take backup for Bigtable table in avro format.
Kerberos authentication in Google Dataproc clusters offers enhanced security and user isolation. It’s a crucial step for multi-tenancy, encryption, and user ...
Welcome back to our series on datastream workflows! In our previous article, we explored the basics of setting up a datastream workflow.
This guide provides detailed instructions on setting up a datastream connection from Cloud SQL (MySQL) to BigQuery. We aim to simplify the process by using d...
Ansible is a powerful automation tool that simplifies infrastructure management and application deployment. However, like any technology, it’s easy to make m...
Ansible is a powerful automation tool that allows you to manage and configure infrastructure as code. Back when we were running 100s of hadoop nodes these we...
Creating an Ansible Collection: A Comprehensive Guide
Are you ready to dive into the world of automation? Ansible is a powerful tool that allows you to manage and configure systems with ease. This blog post will...
Linux Unified Key Setup (LUKS) is the standard on-disk block encryption format for Linux. Using the kernel’s dm-crypt device-mapper subsystem and the cryptse...
YARN distcp.
Usually distcp and other batch jobs run for a very long time. This is fine if you are running a HADOOP environment without kerberos. When we kerberize a clus...
distcp.
When you see this error default thing to do is the set the HADOOP_CLIENT_OPTS config on your env. In My case did a typo HADDOP_CLIENT_OPTS which caused us sp...
Was setting up jekyll using docker, but was not able to install ruby on the docker machine as apt-add-repository was not working. Below is my Dockerfile when...
Pandoc is an open-source universal document converter capable of transforming technical documentation written in Markdown into PDF, Microsoft Word (.docx), H...
Changing the timezone on your Ubuntu server is a crucial task for ensuring accurate timekeeping, especially when dealing with scheduled tasks, logs, and appl...
Linux Unified Key Setup (LUKS) is the standard on-disk block encryption format for Linux. Using the kernel’s dm-crypt device-mapper subsystem and the cryptse...
After migrating or restoring a Nagios XI server, navigating to the Servicegroup Summary, Hostgroup Summary, or legacy Nagios Core CGI views may fail with one...
We have 2 domains forests in our environment, ABC and XYZ. We were not able to authenticate normal users from either of the domains. Most of the information ...
Not Enough Physical Memory Error in VMware Workstation 10 on Windows 8.1
Are you encountering the frustrating “Not enough physical memory is available to power this virtual machine” error in VMware Workstation 10 after a Windows u...
null_resource with local-exec and remote-exec in Terraform
Terraform, a widely adopted Infrastructure as Code (IaC) tool, offers a rich array of resources and provisioners for efficiently managing and configuring inf...
In this blog post, we will venture into exporting data from Firestore and Datastore modes. Find the code on Github.
Nginx with Heartbeat - A Step-by-Step Guide
In today’s digital landscape, ensuring high availability for your web applications is paramount. Downtime can lead to lost revenue, damaged reputation, and ...
Terraform Cloud Functions Cloud Monitoring.
This blog post demonstrates how to automate Firestore health checks using Terraform to deploy a Cloud Function (Gen 1) and set up a complete monitoring and a...
Ensuring the health and availability of your Firestore database is crucial for maintaining a reliable application. This post provides a Python script that se...
Easy way to collect files recursively over a sftp server is to connect to the server over scp and do scp -r. Problem was that the device we were connecting ...
sysctl.conf for Web and FTP Servers
The sysctl interface provides a powerful way to modify the behavior of a running Linux kernel. By editing the /etc/sysctl.conf file, you can persistently co...
Creating an Ansible Collection: A Comprehensive Guide
Ensuring consistency and streamlining infrastructure provisioning is crucial for effective cloud management. Creating custom virtual machine (VM) images on G...
Using Ansible within the initialization script of a Google Compute Engine (GCE) instance can streamline and automate the configuration and setup of your virt...
Infrastructure as Code (IaC) has revolutionized how we manage and provision infrastructure. Tools like Terraform allow us to define our infrastructure in cod...
Terraform Cloud Functions Cloud Monitoring.
This blog post demonstrates how to automate Firestore health checks using Terraform to deploy a Cloud Function (Gen 1) and set up a complete monitoring and a...
Cloud VPN securely connects your peer network to your Virtual Private Cloud (VPC) network through an IPsec VPN connection.
Stackdriver driver provides monitoring, logging, error reporting, tracing and debugging services. Currently known as Google Cloud’s operations suite.
Cloud SQL is a fully managed service which includes MySQL, PostgreSQL, Microsoft SQL Server. And for horizontal scalability, consider using Cloud Spanner.
Google Cloud offers IAM, which lets you give more granular access to specific Google Cloud resources and prevents unwanted access to other resources.
Cloud Storage is Google Cloud’s object storage service, and it allows worldwide storage and retrieval of any amount of data at anytime.
Security is paramount when setting up resources in the cloud or on-premises. It encompasses various layers of protection, including network security, encrypt...
null_resource with local-exec and remote-exec in Terraform
Terraform, a widely adopted Infrastructure as Code (IaC) tool, offers a rich array of resources and provisioners for efficiently managing and configuring inf...
getmerge command takes a source directory and a destination file as input and concatenates files in src into the destination local file.
Easy way to collect files recursively over a sftp server is to connect to the server over scp and do scp -r. Problem was that the device we were connecting ...
Infrastructure as Code (IaC) has revolutionized how we manage and provision infrastructure. Tools like Terraform allow us to define our infrastructure in cod...
Ensuring the health and availability of your Firestore database is crucial for maintaining a reliable application. This post provides a Python script that se...
parted.
GUID Partition Table (GPT) is a standard for the layout of the partition table on a physical hard disk, using globally unique identifiers (GUID). Although it...
CMAN v3 is a Corsync plugin that monitors the names and number of active cluster nodes in order to deliver membership and quorum information to clients (such...
HAProxy is a robust, high-performance TCP/HTTP load balancer, perfectly suited for ensuring high availability and efficient traffic distribution across your ...
getmerge command takes a source directory and a destination file as input and concatenates files in src into the destination local file.
YARN distcp.
Usually distcp and other batch jobs run for a very long time. This is fine if you are running a HADOOP environment without kerberos. When we kerberize a clus...
distcp.
When you see this error default thing to do is the set the HADOOP_CLIENT_OPTS config on your env. In My case did a typo HADDOP_CLIENT_OPTS which caused us sp...
doBulkLoad - LoadIncrementalHfiles failed. This is recoverable. Hbase Encryption Zone.
We were working with a team who were uploading data into HBASE using the doBulkLoad, also we had moved the /hbase to encryption zone. The issue started after...
HDFS health using fsck.
When we have large data sets on the cluster, there will be corruptions of blocks. This could be due to disk or any other.
HBase Error Could not seek StoreFileScanner Invalid HFile block magic
We ran into an issue which was causing HBase to fail. When the job was rerun then it would work again. In the logs we got 2 errors.
We were deploying one of the cluster on our lab environment which is used by everyone. So the lab has it own share of stale information on it.
We had a cluster environment which we needed to update the /etc/hosts file. Which would help communicate between the server over a private network. Our serve...
Python API for cloudera is really nice, apart from getting the cluster setup, we can also do configuration and automation. We use a lot of automation using C...
This is the second follow up post. In the earlier post
This is the second follow up post. In the earlier post Setting Up Cloudera Manager Services Using Cloudera API [Part 1] we install the cloudera management se...
Cloudera API is a very convenient way to setup a cluster and do more.
This is a basic steps to get connected with cloudera manager.
These are a set of testing which we can do on a Hadoop environment. These are basic testing to make sure the environment is setup correctly.
0.0.0.0 [Cloudera]
We were working on setting up a cluster, but the Hue URL was set to a private IP of the server. As we had setup all the nodes to access each other using a pr...
Setting up yum repos on RHEL using httpd. We will be setting up httpd and yum repo on top of it. So that we can access yum over http.
SSSD can use an LDAP filter to decide which directory users are allowed to log in to a Linux host. This is useful when accounts should remain visible in the ...
Upgrading Cloudera Manager 5 to the Latest Cloudera Manager, In most cases it is possible to complete the following upgrade without shutting down most CDH se...
Apache Hive is a powerful data warehousing application built on top of Hadoop; it enables you to access your data using Hive QL, a language that is similar t...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
Pentaho Data Integration (PDI) is a suite of open source Business Intelligence (BI) products which provide data integration, OLAP services, reporting, dashb...
We have 2 domains forests in our environment, ABC and XYZ. We were not able to authenticate normal users from either of the domains. Most of the information ...
eth1 to eth0 on EDGE node.
Adding route to all the slaves which reside on a private network to communicate with External Server directly using an EDGE node using Interface Forwarding.
ansible on RHEL 6.6.
Ansible is a radically simple IT automation engine that automates cloud provisioning, configuration management, application deployment, intra-service orchest...
tarball.
This is a simple zookeeper playbook, to quickly start zookeeper running on a single or more nodes, in a clustered mode.
This is a simple Storm Cluster Setup. We are using a dedicated Zookeeper Cluster/Node, instead of the standalone zkserver. Below is how we will deploy our c...
This is a simple Kafka setup. In this setup we are running kafka over a dedicated zookeeper service. (NOT the standalone zookeeper which comes with kafka)
tarball.
Setting up Hadoop using Ansible, we will be using cdh5 tarball for installation of the cluster.
The Apache Cassandra database is the right choice when you need scalability and high availability without compromising performance. Linear scalability and pr...
Getting HBase to perform well in a production environment is an iterative process that involves tweaking various configuration parameters. This post dives de...
YARN - A Detailed Guide for Ubuntu 12.04 LTS
HBase is a powerful open-source, non-relational, distributed database designed for handling massive datasets. Inspired by Google’s BigTable, HBase is written...
Apache Kafka is often described as a distributed, fault-tolerant, high-throughput publish-subscribe messaging system. Think of it as a central nervous system...
sysctl.conf
This post delves into optimizing Hadoop performance at the kernel level using sysctl. The sysctl interface provides a way to dynamically modify a running Lin...
Swappiness is a crucial Linux kernel parameter that dictates how aggressively the system uses swap space. Understanding and configuring swappiness can signif...
First lets setup the Hbase Configuration Files. For pseudo-distributed replace with 'localhost'
Apache HBase is a powerful NoSQL database, but out-of-the-box, it’s a bit like a house with no locks on the doors. Any user who can connect to the cluster ca...
This script can be used to monitor Namenode Parameters. This script can be used to Generate Zabbix Import XML or Send monitoring data to Zabbix server.
First lets setup the Hbase Configuration Files. For pseudo-distributed replace with 'localhost'
CMAN v3 is a Corsync plugin that monitors the names and number of active cluster nodes in order to deliver membership and quorum information to clients (such...
HAProxy is a robust, high-performance TCP/HTTP load balancer, perfectly suited for ensuring high availability and efficient traffic distribution across your ...
We will walk you through the process of setting up HashiCorp Vault to effectively manage your secrets. This guide is an gettinf started with vault with terra...
doBulkLoad - LoadIncrementalHfiles failed. This is recoverable. Hbase Encryption Zone.
We were working with a team who were uploading data into HBASE using the doBulkLoad, also we had moved the /hbase to encryption zone. The issue started after...
HBase Error Could not seek StoreFileScanner Invalid HFile block magic
We ran into an issue which was causing HBase to fail. When the job was rerun then it would work again. In the logs we got 2 errors.
Getting HBase to perform well in a production environment is an iterative process that involves tweaking various configuration parameters. This post dives de...
YARN - A Detailed Guide for Ubuntu 12.04 LTS
HBase is a powerful open-source, non-relational, distributed database designed for handling massive datasets. Inspired by Google’s BigTable, HBase is written...
First lets setup the Hbase Configuration Files. For pseudo-distributed replace with 'localhost'
Apache HBase is a powerful NoSQL database, but out-of-the-box, it’s a bit like a house with no locks on the doors. Any user who can connect to the cluster ca...
First lets setup the Hbase Configuration Files. For pseudo-distributed replace with 'localhost'
getmerge command takes a source directory and a destination file as input and concatenates files in src into the destination local file.
HDFS health using fsck.
When we have large data sets on the cluster, there will be corruptions of blocks. This could be due to disk or any other.
HBase Error Could not seek StoreFileScanner Invalid HFile block magic
We ran into an issue which was causing HBase to fail. When the job was rerun then it would work again. In the logs we got 2 errors.
This is the second follow up post. In the earlier post
First lets setup the Hbase Configuration Files. For pseudo-distributed replace with 'localhost'
Ensuring the health and availability of your Firestore database is crucial for maintaining a reliable application. This post provides a Python script that se...
CMAN v3 is a Corsync plugin that monitors the names and number of active cluster nodes in order to deliver membership and quorum information to clients (such...
Nginx with Heartbeat - A Step-by-Step Guide
In today’s digital landscape, ensuring high availability for your web applications is paramount. Downtime can lead to lost revenue, damaged reputation, and ...
This guide walks you through configuring a High Availability (HA) Apache web server using Heartbeat on CentOS/RHEL 6. HA ensures your web server remains acce...
CMAN v3 is a Corsync plugin that monitors the names and number of active cluster nodes in order to deliver membership and quorum information to clients (such...
HAProxy is a robust, high-performance TCP/HTTP load balancer, perfectly suited for ensuring high availability and efficient traffic distribution across your ...
Nginx with Heartbeat - A Step-by-Step Guide
In today’s digital landscape, ensuring high availability for your web applications is paramount. Downtime can lead to lost revenue, damaged reputation, and ...
mod_jk and httpd on CentOS - In-Memory Session Replication - A Deep Dive
In a previous post, we explored a basic session-based replication setup for SpagoBI. However, that configuration lacked true session redundancy.
NGINX is a powerful and versatile open-source software that excels as an HTTP server, reverse proxy, and IMAP/POP3 proxy server. Renowned for its high perfo...
This guide walks you through configuring a High Availability (HA) Apache web server using Heartbeat on CentOS/RHEL 6. HA ensures your web server remains acce...
Apache Hive is a powerful data warehousing application built on top of Hadoop; it enables you to access your data using Hive QL, a language that is similar t...
Setting up yum repos on RHEL using httpd. We will be setting up httpd and yum repo on top of it. So that we can access yum over http.
Kernel 2.6, x86_64 - A Comprehensive Guide
Siege is a powerful, open-source HTTP load testing and benchmarking utility. It’s designed to help web developers and system administrators measure the perfo...
Nginx with Heartbeat - A Step-by-Step Guide
In today’s digital landscape, ensuring high availability for your web applications is paramount. Downtime can lead to lost revenue, damaged reputation, and ...
mod_jk and httpd on CentOS - In-Memory Session Replication - A Deep Dive
In a previous post, we explored a basic session-based replication setup for SpagoBI. However, that configuration lacked true session redundancy.
This post details how to set up a Tomcat cluster for SpagoBI 5.1, building upon a previous guide for installing SpagoBI with MySQL (post). This configuration...
NGINX is a powerful and versatile open-source software that excels as an HTTP server, reverse proxy, and IMAP/POP3 proxy server. Renowned for its high perfo...
This guide walks you through configuring a High Availability (HA) Apache web server using Heartbeat on CentOS/RHEL 6. HA ensures your web server remains acce...
Setting up yum repos on RHEL using httpd. We will be setting up httpd and yum repo on top of it. So that we can access yum over http.
Nginx with Heartbeat - A Step-by-Step Guide
In today’s digital landscape, ensuring high availability for your web applications is paramount. Downtime can lead to lost revenue, damaged reputation, and ...
mod_jk and httpd on CentOS - In-Memory Session Replication - A Deep Dive
In a previous post, we explored a basic session-based replication setup for SpagoBI. However, that configuration lacked true session redundancy.
NGINX is a powerful and versatile open-source software that excels as an HTTP server, reverse proxy, and IMAP/POP3 proxy server. Renowned for its high perfo...
This guide walks you through configuring a High Availability (HA) Apache web server using Heartbeat on CentOS/RHEL 6. HA ensures your web server remains acce...
Configuring HTTPS (TLS/SSL) on a Nagios XI server encrypts web UI logins, API calls (/nagiosxi/api/v1/), and passive check submissions (/nrdp/). Enabling HTT...
Kernel 2.6, x86_64 - A Comprehensive Guide
Siege is a powerful, open-source HTTP load testing and benchmarking utility. It’s designed to help web developers and system administrators measure the perfo...
Infrastructure as Code (IaC) has revolutionized how we manage and provision infrastructure. Tools like Terraform allow us to define our infrastructure in cod...
Security is paramount when setting up resources in the cloud or on-premises. It encompasses various layers of protection, including network security, encrypt...
Google Cloud offers IAM, which lets you give more granular access to specific Google Cloud resources and prevents unwanted access to other resources.
This comprehensive guide explains how to assign multiple IP addresses to a single network interface in Linux. This technique, often called IP aliasing or cre...
I was working on getting post headers for my post on this blog. I had couple of images from unsplash. But the header for the post need to be a little more ho...
Ansible is a powerful automation tool that simplifies infrastructure management and application deployment. However, like any technology, it’s easy to make m...
python 2.7.x on Centos 6.5/6.6
CentOS 6 was distributed with Python 2.6, while some older applications require Python 2.7. This guide describes two historical installation approaches: usin...
The Java Development Kit (JDK) is an essential tool for Java developers, providing the necessary components to compile, debug, and run Java applications. Whi...
Node.js is an open-source, cross-platform JavaScript runtime environment that executes JavaScript code server-side. It’s incredibly popular for building scal...
Apache Kafka is often described as a distributed, fault-tolerant, high-throughput publish-subscribe messaging system. Think of it as a central nervous system...
This blog post provides a comprehensive, step-by-step guide to integrating NodeJS with Kafka. Whether you’re building real-time data pipelines, implementing ...
iptables - Port forwarding from one interface to another.
iptables is a user-space application program that allows a system administrator to configure the tables provided by the Linux kernel firewall (implemented as...
eth1 to eth0 on EDGE node.
Adding route to all the slaves which reside on a private network to communicate with External Server directly using an EDGE node using Interface Forwarding.
iptables - Port forwarding from one interface to another.
iptables is a user-space application program that allows a system administrator to configure the tables provided by the Linux kernel firewall (implemented as...
This section describes how to get monitoring data from Zabbix server through the command line and export these to a CSV formatted file.
This script is to create a xml import file from a csv file. We use 2 csv file for this.
Module used to generate Zabbix import xml for snmp traps, Below are steps to create a Zabbix Import for Traps. These traps are captured from the snmptrap fun...
Getting HBase to perform well in a production environment is an iterative process that involves tweaking various configuration parameters. This post dives de...
Unable to locate package oracle-java7-installer on Ubuntu
I recently ran into a frustrating issue while trying to install Java 7 on an older Ubuntu system (Ubuntu 13, in this case). The seemingly simple command sud...
zabbix-java-gateway on Centos 6.5
Zabbix 2.0 introduced native support for monitoring JMX applications through the Zabbix Java gateway. This Java-based daemon acts as an intermediary, allowin...
The Java Development Kit (JDK) is an essential tool for Java developers, providing the necessary components to compile, debug, and run Java applications. Whi...
Unable to locate package oracle-java7-installer on Ubuntu
I recently ran into a frustrating issue while trying to install Java 7 on an older Ubuntu system (Ubuntu 13, in this case). The seemingly simple command sud...
The Java Development Kit (JDK) is an essential tool for Java developers, providing the necessary components to compile, debug, and run Java applications. Whi...
Was setting up jekyll using docker, but was not able to install ruby on the docker machine as apt-add-repository was not working. Below is my Dockerfile when...
This guide demonstrates how to build a Node.js application that receives JSON data via HTTP and routes it to different Apache Kafka topics based on the URL p...
Getting HBase to perform well in a production environment is an iterative process that involves tweaking various configuration parameters. This post dives de...
Apache Kafka is a distributed streaming platform. Kafka 2.0 supports Kerberos authentication, Enabling Kerberos Authentication Using the Wizard on cloudera m...
Deployment error during setting zookeeper on a new cluster using Cloudera Manager UI, when an earlier cluster containing zookeeper earlier was built using Cl...
This is a simple Kafka setup. In this setup we are running kafka over a dedicated zookeeper service. (NOT the standalone zookeeper which comes with kafka)
This blog post provides a comprehensive, step-by-step guide to integrating NodeJS with Kafka. Whether you’re building real-time data pipelines, implementing ...
This guide demonstrates how to build a Node.js application that receives JSON data via HTTP and routes it to different Apache Kafka topics based on the URL p...
kafka-node
Ready to integrate your NodeJS application with Kafka? This post provides a comprehensive guide to setting up a Kafka producer using the kafka-node library. ...
This post outlines how to send JSON data from a client (browser or curl) through a NodeJS server and ultimately into a Kafka topic. This architecture is usef...
Apache Kafka is often described as a distributed, fault-tolerant, high-throughput publish-subscribe messaging system. Think of it as a central nervous system...
This blog post provides a comprehensive, step-by-step guide to integrating NodeJS with Kafka. Whether you’re building real-time data pipelines, implementing ...
This guide demonstrates how to build a Node.js application that receives JSON data via HTTP and routes it to different Apache Kafka topics based on the URL p...
kafka-node
Ready to integrate your NodeJS application with Kafka? This post provides a comprehensive guide to setting up a Kafka producer using the kafka-node library. ...
This post outlines how to send JSON data from a client (browser or curl) through a NodeJS server and ultimately into a Kafka topic. This architecture is usef...
Kerberos authentication in Google Dataproc clusters offers enhanced security and user isolation. It’s a crucial step for multi-tenancy, encryption, and user ...
Apache Kafka is a distributed streaming platform. Kafka 2.0 supports Kerberos authentication, Enabling Kerberos Authentication Using the Wizard on cloudera m...
Python API for cloudera is really nice, apart from getting the cluster setup, we can also do configuration and automation. We use a lot of automation using C...
Apache Hive is a powerful data warehousing application built on top of Hadoop; it enables you to access your data using Hive QL, a language that is similar t...
We have 2 domains forests in our environment, ABC and XYZ. We were not able to authenticate normal users from either of the domains. Most of the information ...
Node.js, Nginx
This post provides a detailed sysctl.conf file, optimized for Linux systems running high-performance web servers like Nginx and Node.js applications. The sy...
sysctl.conf for Web and FTP Servers
The sysctl interface provides a powerful way to modify the behavior of a running Linux kernel. By editing the /etc/sysctl.conf file, you can persistently co...
sysctl.conf
This post delves into optimizing Hadoop performance at the kernel level using sysctl. The sysctl interface provides a way to dynamically modify a running Lin...
What is Kitchen? Kitchen provides a test harness to execute infrastructure code on one or more platforms in isolation.
Test Kitchen (kitchen-vagrant) can provision disposable Microsoft Windows Server virtual machines on a Linux or macOS workstation using VirtualBox, Vagrant, ...
Chef Data Bags store global JSON data on the Chef Infra Server that can be queried by any cookbook or node. When storing sensitive data—such as user password...
We have 2 domains forests in our environment, ABC and XYZ. We were not able to authenticate normal users from either of the domains. Most of the information ...
Kernel-based Virtual Machine (KVM) has become a cornerstone of Linux server virtualization, known for its maturity and performance. Red Hat’s decision to fav...
Apache Hive is a powerful data warehousing application built on top of Hadoop; it enables you to access your data using Hive QL, a language that is similar t...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
In this blog post we will be setting up a postgres database on docker using Dockerfile.
Python virtual environment creates a isoloated workspace of python work. This helps in creating project specific virtual environment without worrying about ...
In this blog post we will be setting up a postgres database on docker.
List Comprehensions provides easy and functional way to create list in python. We could make a single line of code which otherwise would take a few lines. l...
Python is a clear and powerful object-oriented programming language, comparable to Perl, Ruby, Scheme, or Java. This is basic documentation for getting star...
Kernel-based Virtual Machine (KVM) has become a cornerstone of Linux server virtualization, known for its maturity and performance. Red Hat’s decision to fav...
Deployment error during setting zookeeper on a new cluster using Cloudera Manager UI, when an earlier cluster containing zookeeper earlier was built using Cl...
We were deploying one of the cluster on our lab environment which is used by everyone. So the lab has it own share of stale information on it.
We had a cluster environment which we needed to update the /etc/hosts file. Which would help communicate between the server over a private network. Our serve...
Python API for cloudera is really nice, apart from getting the cluster setup, we can also do configuration and automation. We use a lot of automation using C...
This is the second follow up post. In the earlier post
This is the second follow up post. In the earlier post Setting Up Cloudera Manager Services Using Cloudera API [Part 1] we install the cloudera management se...
Cloudera API is a very convenient way to setup a cluster and do more.
This is a basic steps to get connected with cloudera manager.
These are a set of testing which we can do on a Hadoop environment. These are basic testing to make sure the environment is setup correctly.
0.0.0.0 [Cloudera]
We were working on setting up a cluster, but the Hue URL was set to a private IP of the server. As we had setup all the nodes to access each other using a pr...
After migrating or restoring a Nagios XI server, navigating to the Servicegroup Summary, Hostgroup Summary, or legacy Nagios Core CGI views may fail with one...
In large Zabbix deployments, the raw history tables (history, history_uint, history_str, history_log, and history_text) frequently grow to tens or hundreds o...
When working on a Windows machine after spending years in Linux, Cygwin provides a POSIX-compatible environment where your custom .bashrc and .vimrc configur...
When monitoring MongoDB 3.x instances from Nagios XI using the built-in check_mongodb.py plugin (originally written for MongoDB 2.x and older versions of pym...
Apache CouchDB is an open-source, document-oriented NoSQL database that stores JSON documents, exposes a native HTTP/RESTful API (on TCP port 5984 by default...
MongoDB is a document-oriented NoSQL database that stores records as BSON (binary JSON) documents with flexible schemas and rich indexing. This guide covers ...
Chef Data Bags store global JSON data on the Chef Infra Server that can be queried by any cookbook or node. When storing sensitive data—such as user password...
Automated log cleanup and backup rotation scripts on Linux frequently rely on GNU find to locate and delete files older than a retention threshold. Evaluatin...
RRDtool (Round Robin Database) stores time-series performance metrics (such as Nagios / PNP4Nagios / Cacti / Zabbix / Ganglia graphs) in a binary file format...
Configuring HTTPS (TLS/SSL) on a Nagios XI server encrypts web UI logins, API calls (/nagiosxi/api/v1/), and passive check submissions (/nrdp/). Enabling HTT...
A standalone Chef Infra Server installation deploys all required backend services (Nginx, PostgreSQL, RabbitMQ, Solr/Elasticsearch, Bookshelf, and Erchef) on...
Pandoc is an open-source universal document converter capable of transforming technical documentation written in Markdown into PDF, Microsoft Word (.docx), H...
When troubleshooting network connectivity or firewall rules between servers, you often need to verify whether a specific TCP or UDP port is open on a remote ...
Linux Unified Key Setup (LUKS) is the standard on-disk block encryption format for Linux. Using the kernel’s dm-crypt device-mapper subsystem and the cryptse...
When the root or /var partition on a Linux database server runs low on disk space, a common remediation is to relocate MySQL’s data directory (datadir, locat...
When a MySQL or MariaDB server runs low on disk space, identifying which schemas and tables consume the most storage is the first step in capacity troublesho...
python 2.7.x on Centos 6.5/6.6
CentOS 6 was distributed with Python 2.6, while some older applications require Python 2.7. This guide describes two historical installation approaches: usin...
postgres and mysql.
Regular database backups are essential after deploying a Zabbix monitoring server. Depending on your recovery requirements and disk capacity, you can take ei...
There might be situations where you have a remote/zabbix server which does not have internet connectivity, due to security or other reasons. So we create a ...
In zabbix we dont have a better way to capture snmptraps. we have to manually create an item and corresponfding trigger to handle a trap arriving from the de...
zabbix-extra on Zabbix Version 2.4.
SNMP Builder/Extra is an add-in for Zabbix. It provides new web interface components to browse MIB trees and values. SNMP OIDs can then be automatically conv...
Receiving SNMP traps is the opposite to querying SNMP-enabled devices. In this case the information is sent from a SNMP-enabled device and is collected or “t...
The System Security Services Daemon (SSSD) provides a set of daemons to manage access to remote directories and authentication mechanisms. It provides Name S...
Setting up yum repos on RHEL using httpd. We will be setting up httpd and yum repo on top of it. So that we can access yum over http.
SSSD can use an LDAP filter to decide which directory users are allowed to log in to a Linux host. This is useful when accounts should remain visible in the ...
Upgrading Cloudera Manager 5 to the Latest Cloudera Manager, In most cases it is possible to complete the following upgrade without shutting down most CDH se...
Apache Hive is a powerful data warehousing application built on top of Hadoop; it enables you to access your data using Hive QL, a language that is similar t...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
iptables - Port forwarding from one interface to another.
iptables is a user-space application program that allows a system administrator to configure the tables provided by the Linux kernel firewall (implemented as...
Pentaho Data Integration (PDI) is a suite of open source Business Intelligence (BI) products which provide data integration, OLAP services, reporting, dashb...
squid as a sibling to an already existing Parent squid.
Squid is a caching and forwarding web proxy. It has a wide variety of uses, from speeding up a web server by caching repeated requests; to caching web, DNS a...
CMAN v3 is a Corsync plugin that monitors the names and number of active cluster nodes in order to deliver membership and quorum information to clients (such...
eth1 to eth0 on EDGE node.
Adding route to all the slaves which reside on a private network to communicate with External Server directly using an EDGE node using Interface Forwarding.
ansible on RHEL 6.6.
Ansible is a radically simple IT automation engine that automates cloud provisioning, configuration management, application deployment, intra-service orchest...
parted.
GUID Partition Table (GPT) is a standard for the layout of the partition table on a physical hard disk, using globally unique identifiers (GUID). Although it...
A Network File System (NFS) allows remote hosts to mount file systems over a network and interact with those file systems as though they are mounted locally....
tarball.
This is a simple zookeeper playbook, to quickly start zookeeper running on a single or more nodes, in a clustered mode.
This is a simple Storm Cluster Setup. We are using a dedicated Zookeeper Cluster/Node, instead of the standalone zkserver. Below is how we will deploy our c...
This is a simple Kafka setup. In this setup we are running kafka over a dedicated zookeeper service. (NOT the standalone zookeeper which comes with kafka)
tarball.
Setting up Hadoop using Ansible, we will be using cdh5 tarball for installation of the cluster.
Apache Spark is an in-memory distributed data analysis platform– primarily targeted at speeding up batch analysis jobs, iterative machine learning jobs, inte...
You can enter a linux system without entring a password using below steps. We will be creating a ssh jey which will be share between the servers, which will ...
The Apache Cassandra database is the right choice when you need scalability and high availability without compromising performance. Linear scalability and pr...
The SpagoBI project is a free software/open source initiative by the SpagoBI Labs of Engineering Group. It aims to realize the most complete 100% open source...
Kernel-based Virtual Machine (KVM) has become a cornerstone of Linux server virtualization, known for its maturity and performance. Red Hat’s decision to fav...
Getting HBase to perform well in a production environment is an iterative process that involves tweaking various configuration parameters. This post dives de...
YARN - A Detailed Guide for Ubuntu 12.04 LTS
HBase is a powerful open-source, non-relational, distributed database designed for handling massive datasets. Inspired by Google’s BigTable, HBase is written...
Unable to locate package oracle-java7-installer on Ubuntu
I recently ran into a frustrating issue while trying to install Java 7 on an older Ubuntu system (Ubuntu 13, in this case). The seemingly simple command sud...
zabbix-java-gateway on Centos 6.5
Zabbix 2.0 introduced native support for monitoring JMX applications through the Zabbix Java gateway. This Java-based daemon acts as an intermediary, allowin...
HAProxy is a robust, high-performance TCP/HTTP load balancer, perfectly suited for ensuring high availability and efficient traffic distribution across your ...
npm Behind a Corporate Proxy - A Comprehensive Guide
npm, short for Node Package Manager, is the cornerstone of JavaScript development within the Node.js ecosystem. It simplifies the process of managing projec...
This blog post provides a comprehensive, step-by-step guide to integrating NodeJS with Kafka. Whether you’re building real-time data pipelines, implementing ...
This guide demonstrates how to build a Node.js application that receives JSON data via HTTP and routes it to different Apache Kafka topics based on the URL p...
kafka-node
Ready to integrate your NodeJS application with Kafka? This post provides a comprehensive guide to setting up a Kafka producer using the kafka-node library. ...
This post outlines how to send JSON data from a client (browser or curl) through a NodeJS server and ultimately into a Kafka topic. This architecture is usef...
Node.js is an open-source, cross-platform JavaScript runtime environment that executes JavaScript code server-side. It’s incredibly popular for building scal...
Apache Kafka is often described as a distributed, fault-tolerant, high-throughput publish-subscribe messaging system. Think of it as a central nervous system...
sudo effective uid is not 0 Error on Linux
Encountered a frustrating issue on a Linux server while trying to use sudo? Specifically, the error message: sudo: effective uid is not 0, is sudo installed ...
Node.js, Nginx
This post provides a detailed sysctl.conf file, optimized for Linux systems running high-performance web servers like Nginx and Node.js applications. The sy...
sysctl.conf for Web and FTP Servers
The sysctl interface provides a powerful way to modify the behavior of a running Linux kernel. By editing the /etc/sysctl.conf file, you can persistently co...
This comprehensive guide explains how to assign multiple IP addresses to a single network interface in Linux. This technique, often called IP aliasing or cre...
Changing the timezone on your Ubuntu server is a crucial task for ensuring accurate timekeeping, especially when dealing with scheduled tasks, logs, and appl...
sysctl.conf
This post delves into optimizing Hadoop performance at the kernel level using sysctl. The sysctl interface provides a way to dynamically modify a running Lin...
The Java Development Kit (JDK) is an essential tool for Java developers, providing the necessary components to compile, debug, and run Java applications. Whi...
This script provides a simple way to create users on CentOS/RHEL 6.5 systems from the command line. It allows you to create both normal and sudo (administrat...
nginx
Nginx (pronounced “engine x”) is a powerful and versatile web server renowned for its high concurrency, exceptional performance, and efficient memory utiliza...
Swappiness is a crucial Linux kernel parameter that dictates how aggressively the system uses swap space. Understanding and configuring swappiness can signif...
Nginx with Heartbeat - A Step-by-Step Guide
In today’s digital landscape, ensuring high availability for your web applications is paramount. Downtime can lead to lost revenue, damaged reputation, and ...
mod_jk and httpd on CentOS - In-Memory Session Replication - A Deep Dive
In a previous post, we explored a basic session-based replication setup for SpagoBI. However, that configuration lacked true session redundancy.
This post details how to set up a Tomcat cluster for SpagoBI 5.1, building upon a previous guide for installing SpagoBI with MySQL (post). This configuration...
NGINX is a powerful and versatile open-source software that excels as an HTTP server, reverse proxy, and IMAP/POP3 proxy server. Renowned for its high perfo...
This guide walks you through configuring a High Availability (HA) Apache web server using Heartbeat on CentOS/RHEL 6. HA ensures your web server remains acce...
This script can be used to monitor Namenode Parameters. This script can be used to Generate Zabbix Import XML or Send monitoring data to Zabbix server.
This section describes how to get monitoring data from Zabbix server through the command line and export these to a CSV formatted file.
This script is to create a xml import file from a csv file. We use 2 csv file for this.
Send Zabbix metric by reading from a XML file. This needs package zbxsend from : https://github.com/ahmedzbyr/zbxsend
Module used to generate Zabbix import xml for snmp traps, Below are steps to create a Zabbix Import for Traps. These traps are captured from the snmptrap fun...
Easy way to collect files recursively over a sftp server is to connect to the server over scp and do scp -r. Problem was that the device we were connecting ...
HAProxy is a robust, high-performance TCP/HTTP load balancer, perfectly suited for ensuring high availability and efficient traffic distribution across your ...
nginx
Nginx (pronounced “engine x”) is a powerful and versatile web server renowned for its high concurrency, exceptional performance, and efficient memory utiliza...
Nginx with Heartbeat - A Step-by-Step Guide
In today’s digital landscape, ensuring high availability for your web applications is paramount. Downtime can lead to lost revenue, damaged reputation, and ...
mod_jk and httpd on CentOS - In-Memory Session Replication - A Deep Dive
In a previous post, we explored a basic session-based replication setup for SpagoBI. However, that configuration lacked true session redundancy.
NGINX is a powerful and versatile open-source software that excels as an HTTP server, reverse proxy, and IMAP/POP3 proxy server. Renowned for its high perfo...
Tsung (formerly known as idx-Tsunami) is a powerful, open-source, multi-protocol distributed load testing tool. Written in Erlang, it’s licensed under the GP...
Kernel 2.6, x86_64 - A Comprehensive Guide
Siege is a powerful, open-source HTTP load testing and benchmarking utility. It’s designed to help web developers and system administrators measure the perfo...
Application logs are a treasure trove of information. Beyond debugging and troubleshooting, they can provide valuable insights into your application’s perfor...
Linux Unified Key Setup (LUKS) is the standard on-disk block encryption format for Linux. Using the kernel’s dm-crypt device-mapper subsystem and the cryptse...
Upgrading Cloudera Manager 5 to the Latest Cloudera Manager, In most cases it is possible to complete the following upgrade without shutting down most CDH se...
Pentaho Data Integration (PDI) is a suite of open source Business Intelligence (BI) products which provide data integration, OLAP services, reporting, dashb...
Not Enough Physical Memory Error in VMware Workstation 10 on Windows 8.1
Are you encountering the frustrating “Not enough physical memory is available to power this virtual machine” error in VMware Workstation 10 after a Windows u...
kafka-node
Ready to integrate your NodeJS application with Kafka? This post provides a comprehensive guide to setting up a Kafka producer using the kafka-node library. ...
Apache Kafka is often described as a distributed, fault-tolerant, high-throughput publish-subscribe messaging system. Think of it as a central nervous system...
Application logs are a treasure trove of information. Beyond debugging and troubleshooting, they can provide valuable insights into your application’s perfor...
This script can be used to monitor Namenode Parameters. This script can be used to Generate Zabbix Import XML or Send monitoring data to Zabbix server.
This section describes how to get monitoring data from Zabbix server through the command line and export these to a CSV formatted file.
This script is to create a xml import file from a csv file. We use 2 csv file for this.
Send Zabbix metric by reading from a XML file. This needs package zbxsend from : https://github.com/ahmedzbyr/zbxsend
Module used to generate Zabbix import xml for snmp traps, Below are steps to create a Zabbix Import for Traps. These traps are captured from the snmptrap fun...
mod_jk and httpd on CentOS - In-Memory Session Replication - A Deep Dive
In a previous post, we explored a basic session-based replication setup for SpagoBI. However, that configuration lacked true session redundancy.
Creating an Ansible Collection: A Comprehensive Guide
Creating an Ansible Collection: A Comprehensive Guide
When monitoring MongoDB 3.x instances from Nagios XI using the built-in check_mongodb.py plugin (originally written for MongoDB 2.x and older versions of pym...
MongoDB is a document-oriented NoSQL database that stores records as BSON (binary JSON) documents with flexible schemas and rich indexing. This guide covers ...
neo4j_doc_manager.
We had a requirement where we wanted to have all the data which is in mongodb to be replicated on neo4j to show few graphs. Here is quick way to demonstrate ...
When monitoring MongoDB 3.x instances from Nagios XI using the built-in check_mongodb.py plugin (originally written for MongoDB 2.x and older versions of pym...
MongoDB is a document-oriented NoSQL database that stores records as BSON (binary JSON) documents with flexible schemas and rich indexing. This guide covers ...
Terraform Cloud Functions Cloud Monitoring.
This blog post demonstrates how to automate Firestore health checks using Terraform to deploy a Cloud Function (Gen 1) and set up a complete monitoring and a...
Ensuring the health and availability of your Firestore database is crucial for maintaining a reliable application. This post provides a Python script that se...
Application logs are a treasure trove of information. Beyond debugging and troubleshooting, they can provide valuable insights into your application’s perfor...
Cloud VPN securely connects your peer network to your Virtual Private Cloud (VPC) network through an IPsec VPN connection.
Stackdriver driver provides monitoring, logging, error reporting, tracing and debugging services. Currently known as Google Cloud’s operations suite.
After migrating or restoring a Nagios XI server, navigating to the Servicegroup Summary, Hostgroup Summary, or legacy Nagios Core CGI views may fail with one...
In large Zabbix deployments, the raw history tables (history, history_uint, history_str, history_log, and history_text) frequently grow to tens or hundreds o...
knife is the command-line tool that bridges your local chef-repo on a Chef Workstation and the Chef Infra Server. It allows administrators to manage nodes, c...
Migrating Nagios XI to a new server is straightforward using its built-in backup_xi.sh and restore_xi.sh utilities. Once the backup archive is restored onto ...
Configuring HTTPS (TLS/SSL) on a Nagios XI server encrypts web UI logins, API calls (/nagiosxi/api/v1/), and passive check submissions (/nrdp/). Enabling HTT...
Nagios XI monitors hosts, network services, and application metrics across Linux and Windows environments, alerting administrators when checks enter warning ...
postgres and mysql.
Regular database backups are essential after deploying a Zabbix monitoring server. Depending on your recovery requirements and disk capacity, you can take ei...
There might be situations where you have a remote/zabbix server which does not have internet connectivity, due to security or other reasons. So we create a ...
In zabbix we dont have a better way to capture snmptraps. we have to manually create an item and corresponfding trigger to handle a trap arriving from the de...
zabbix-extra on Zabbix Version 2.4.
SNMP Builder/Extra is an add-in for Zabbix. It provides new web interface components to browse MIB trees and values. SNMP OIDs can then be automatically conv...
zabbix-java-gateway on Centos 6.5
Zabbix 2.0 introduced native support for monitoring JMX applications through the Zabbix Java gateway. This Java-based daemon acts as an intermediary, allowin...
Zabbix is the ultimate enterprise-level software designed for monitoring availability and performance of IT infrastructure components. Zabbix is open source ...
This script can be used to monitor Namenode Parameters. This script can be used to Generate Zabbix Import XML or Send monitoring data to Zabbix server.
This section describes how to get monitoring data from Zabbix server through the command line and export these to a CSV formatted file.
This script is to create a xml import file from a csv file. We use 2 csv file for this.
Send Zabbix metric by reading from a XML file. This needs package zbxsend from : https://github.com/ahmedzbyr/zbxsend
Module used to generate Zabbix import xml for snmp traps, Below are steps to create a Zabbix Import for Traps. These traps are captured from the snmptrap fun...
parted.
GUID Partition Table (GPT) is a standard for the layout of the partition table on a physical hard disk, using globally unique identifiers (GUID). Although it...
A Network File System (NFS) allows remote hosts to mount file systems over a network and interact with those file systems as though they are mounted locally....
This comprehensive guide explains how to assign multiple IP addresses to a single network interface in Linux. This technique, often called IP aliasing or cre...
When the root or /var partition on a Linux database server runs low on disk space, a common remediation is to relocate MySQL’s data directory (datadir, locat...
When a MySQL or MariaDB server runs low on disk space, identifying which schemas and tables consume the most storage is the first step in capacity troublesho...
postgres and mysql.
Regular database backups are essential after deploying a Zabbix monitoring server. Depending on your recovery requirements and disk capacity, you can take ei...
The SpagoBI project is a free software/open source initiative by the SpagoBI Labs of Engineering Group. It aims to realize the most complete 100% open source...
After migrating or restoring a Nagios XI server, navigating to the Servicegroup Summary, Hostgroup Summary, or legacy Nagios Core CGI views may fail with one...
In large Zabbix deployments, the raw history tables (history, history_uint, history_str, history_log, and history_text) frequently grow to tens or hundreds o...
When monitoring MongoDB 3.x instances from Nagios XI using the built-in check_mongodb.py plugin (originally written for MongoDB 2.x and older versions of pym...
Apache CouchDB is an open-source, document-oriented NoSQL database that stores JSON documents, exposes a native HTTP/RESTful API (on TCP port 5984 by default...
MongoDB is a document-oriented NoSQL database that stores records as BSON (binary JSON) documents with flexible schemas and rich indexing. This guide covers ...
knife is the command-line tool that bridges your local chef-repo on a Chef Workstation and the Chef Infra Server. It allows administrators to manage nodes, c...
RRDtool (Round Robin Database) stores time-series performance metrics (such as Nagios / PNP4Nagios / Cacti / Zabbix / Ganglia graphs) in a binary file format...
Migrating Nagios XI to a new server is straightforward using its built-in backup_xi.sh and restore_xi.sh utilities. Once the backup archive is restored onto ...
Configuring HTTPS (TLS/SSL) on a Nagios XI server encrypts web UI logins, API calls (/nagiosxi/api/v1/), and passive check submissions (/nrdp/). Enabling HTT...
Nagios XI monitors hosts, network services, and application metrics across Linux and Windows environments, alerting administrators when checks enter warning ...
postgres and mysql.
Regular database backups are essential after deploying a Zabbix monitoring server. Depending on your recovery requirements and disk capacity, you can take ei...
There might be situations where you have a remote/zabbix server which does not have internet connectivity, due to security or other reasons. So we create a ...
In zabbix we dont have a better way to capture snmptraps. we have to manually create an item and corresponfding trigger to handle a trap arriving from the de...
zabbix-extra on Zabbix Version 2.4.
SNMP Builder/Extra is an add-in for Zabbix. It provides new web interface components to browse MIB trees and values. SNMP OIDs can then be automatically conv...
zabbix-java-gateway on Centos 6.5
Zabbix 2.0 introduced native support for monitoring JMX applications through the Zabbix Java gateway. This Java-based daemon acts as an intermediary, allowin...
Zabbix is the ultimate enterprise-level software designed for monitoring availability and performance of IT infrastructure components. Zabbix is open source ...
This script can be used to monitor Namenode Parameters. This script can be used to Generate Zabbix Import XML or Send monitoring data to Zabbix server.
This section describes how to get monitoring data from Zabbix server through the command line and export these to a CSV formatted file.
This script is to create a xml import file from a csv file. We use 2 csv file for this.
Send Zabbix metric by reading from a XML file. This needs package zbxsend from : https://github.com/ahmedzbyr/zbxsend
Module used to generate Zabbix import xml for snmp traps, Below are steps to create a Zabbix Import for Traps. These traps are captured from the snmptrap fun...
After migrating or restoring a Nagios XI server, navigating to the Servicegroup Summary, Hostgroup Summary, or legacy Nagios Core CGI views may fail with one...
In large Zabbix deployments, the raw history tables (history, history_uint, history_str, history_log, and history_text) frequently grow to tens or hundreds o...
When monitoring MongoDB 3.x instances from Nagios XI using the built-in check_mongodb.py plugin (originally written for MongoDB 2.x and older versions of pym...
Migrating Nagios XI to a new server is straightforward using its built-in backup_xi.sh and restore_xi.sh utilities. Once the backup archive is restored onto ...
Configuring HTTPS (TLS/SSL) on a Nagios XI server encrypts web UI logins, API calls (/nagiosxi/api/v1/), and passive check submissions (/nrdp/). Enabling HTT...
Nagios XI monitors hosts, network services, and application metrics across Linux and Windows environments, alerting administrators when checks enter warning ...
When troubleshooting network connectivity or firewall rules between servers, you often need to verify whether a specific TCP or UDP port is open on a remote ...
neo4j_doc_manager.
We had a requirement where we wanted to have all the data which is in mongodb to be replicated on neo4j to show few graphs. Here is quick way to demonstrate ...
iptables - Port forwarding from one interface to another.
iptables is a user-space application program that allows a system administrator to configure the tables provided by the Linux kernel firewall (implemented as...
eth1 to eth0 on EDGE node.
Adding route to all the slaves which reside on a private network to communicate with External Server directly using an EDGE node using Interface Forwarding.
This comprehensive guide explains how to assign multiple IP addresses to a single network interface in Linux. This technique, often called IP aliasing or cre...
Kernel-based Virtual Machine (KVM) has become a cornerstone of Linux server virtualization, known for its maturity and performance. Red Hat’s decision to fav...
npm Behind a Corporate Proxy - A Comprehensive Guide
npm, short for Node Package Manager, is the cornerstone of JavaScript development within the Node.js ecosystem. It simplifies the process of managing projec...
A Network File System (NFS) allows remote hosts to mount file systems over a network and interact with those file systems as though they are mounted locally....
Are you ready to dive into the world of automation? Ansible is a powerful tool that allows you to manage and configure systems with ease. This blog post will...
HAProxy is a robust, high-performance TCP/HTTP load balancer, perfectly suited for ensuring high availability and efficient traffic distribution across your ...
Node.js, Nginx
This post provides a detailed sysctl.conf file, optimized for Linux systems running high-performance web servers like Nginx and Node.js applications. The sy...
nginx
Nginx (pronounced “engine x”) is a powerful and versatile web server renowned for its high concurrency, exceptional performance, and efficient memory utiliza...
Nginx with Heartbeat - A Step-by-Step Guide
In today’s digital landscape, ensuring high availability for your web applications is paramount. Downtime can lead to lost revenue, damaged reputation, and ...
NGINX is a powerful and versatile open-source software that excels as an HTTP server, reverse proxy, and IMAP/POP3 proxy server. Renowned for its high perfo...
npm Behind a Corporate Proxy - A Comprehensive Guide
npm, short for Node Package Manager, is the cornerstone of JavaScript development within the Node.js ecosystem. It simplifies the process of managing projec...
This blog post provides a comprehensive, step-by-step guide to integrating NodeJS with Kafka. Whether you’re building real-time data pipelines, implementing ...
This guide demonstrates how to build a Node.js application that receives JSON data via HTTP and routes it to different Apache Kafka topics based on the URL p...
kafka-node
Ready to integrate your NodeJS application with Kafka? This post provides a comprehensive guide to setting up a Kafka producer using the kafka-node library. ...
This post outlines how to send JSON data from a client (browser or curl) through a NodeJS server and ultimately into a Kafka topic. This architecture is usef...
Node.js is an open-source, cross-platform JavaScript runtime environment that executes JavaScript code server-side. It’s incredibly popular for building scal...
Node.js, Nginx
This post provides a detailed sysctl.conf file, optimized for Linux systems running high-performance web servers like Nginx and Node.js applications. The sy...
npm Behind a Corporate Proxy - A Comprehensive Guide
npm, short for Node Package Manager, is the cornerstone of JavaScript development within the Node.js ecosystem. It simplifies the process of managing projec...
null_resource with local-exec and remote-exec in Terraform
Terraform, a widely adopted Infrastructure as Code (IaC) tool, offers a rich array of resources and provisioners for efficiently managing and configuring inf...
Application logs are a treasure trove of information. Beyond debugging and troubleshooting, they can provide valuable insights into your application’s perfor...
There might be situations where you have a remote/zabbix server which does not have internet connectivity, due to security or other reasons. So we create a ...
In zabbix we dont have a better way to capture snmptraps. we have to manually create an item and corresponfding trigger to handle a trap arriving from the de...
Ansible is a powerful automation tool that allows you to manage and configure infrastructure as code. Back when we were running 100s of hadoop nodes these we...
knife is the command-line tool that bridges your local chef-repo on a Chef Workstation and the Chef Infra Server. It allows administrators to manage nodes, c...
Migrating Nagios XI to a new server is straightforward using its built-in backup_xi.sh and restore_xi.sh utilities. Once the backup archive is restored onto ...
Node.js, Nginx
This post provides a detailed sysctl.conf file, optimized for Linux systems running high-performance web servers like Nginx and Node.js applications. The sy...
sysctl.conf
This post delves into optimizing Hadoop performance at the kernel level using sysctl. The sysctl interface provides a way to dynamically modify a running Lin...
CMAN v3 is a Corsync plugin that monitors the names and number of active cluster nodes in order to deliver membership and quorum information to clients (such...
Unable to locate package oracle-java7-installer on Ubuntu
I recently ran into a frustrating issue while trying to install Java 7 on an older Ubuntu system (Ubuntu 13, in this case). The seemingly simple command sud...
Ensuring consistency and streamlining infrastructure provisioning is crucial for effective cloud management. Creating custom virtual machine (VM) images on G...
The System Security Services Daemon (SSSD) provides a set of daemons to manage access to remote directories and authentication mechanisms. It provides Name S...
parted.
GUID Partition Table (GPT) is a standard for the layout of the partition table on a physical hard disk, using globally unique identifiers (GUID). Although it...
Pentaho Data Integration (PDI) is a suite of open source Business Intelligence (BI) products which provide data integration, OLAP services, reporting, dashb...
Node.js, Nginx
This post provides a detailed sysctl.conf file, optimized for Linux systems running high-performance web servers like Nginx and Node.js applications. The sy...
sysctl.conf for Web and FTP Servers
The sysctl interface provides a powerful way to modify the behavior of a running Linux kernel. By editing the /etc/sysctl.conf file, you can persistently co...
sysctl.conf
This post delves into optimizing Hadoop performance at the kernel level using sysctl. The sysctl interface provides a way to dynamically modify a running Lin...
nginx
Nginx (pronounced “engine x”) is a powerful and versatile web server renowned for its high concurrency, exceptional performance, and efficient memory utiliza...
Tsung (formerly known as idx-Tsunami) is a powerful, open-source, multi-protocol distributed load testing tool. Written in Erlang, it’s licensed under the GP...
Kernel 2.6, x86_64 - A Comprehensive Guide
Siege is a powerful, open-source HTTP load testing and benchmarking utility. It’s designed to help web developers and system administrators measure the perfo...
Getting HBase to perform well in a production environment is an iterative process that involves tweaking various configuration parameters. This post dives de...
sudo effective uid is not 0 Error on Linux
Encountered a frustrating issue on a Linux server while trying to use sudo? Specifically, the error message: sudo: effective uid is not 0, is sudo installed ...
Data is invaluable, and as any developer would testify, ensuring its security and availability in the event of unintended deletion or modification is paramou...
Are you ready to dive into the world of automation? Ansible is a powerful tool that allows you to manage and configure systems with ease. This blog post will...
iptables - Port forwarding from one interface to another.
iptables is a user-space application program that allows a system administrator to configure the tables provided by the Linux kernel firewall (implemented as...
In this blog post we will be setting up a postgres database on docker using Dockerfile.
In this blog post we will be setting up a postgres database on docker.
postgres and mysql.
Regular database backups are essential after deploying a Zabbix monitoring server. Depending on your recovery requirements and disk capacity, you can take ei...
kafka-node
Ready to integrate your NodeJS application with Kafka? This post provides a comprehensive guide to setting up a Kafka producer using the kafka-node library. ...
Welcome back to our series on datastream workflows! In our previous article, we explored the basics of setting up a datastream workflow.
squid as a sibling to an already existing Parent squid.
Squid is a caching and forwarding web proxy. It has a wide variety of uses, from speeding up a web server by caching repeated requests; to caching web, DNS a...
HAProxy is a robust, high-performance TCP/HTTP load balancer, perfectly suited for ensuring high availability and efficient traffic distribution across your ...
npm Behind a Corporate Proxy - A Comprehensive Guide
npm, short for Node Package Manager, is the cornerstone of JavaScript development within the Node.js ecosystem. It simplifies the process of managing projec...
Creating an Ansible Collection: A Comprehensive Guide
Ensuring the health and availability of your Firestore database is crucial for maintaining a reliable application. This post provides a Python script that se...
In this blog post, we will venture into exporting data from Firestore and Datastore modes. Find the code on Github.
Data is invaluable, and as any developer would testify, ensuring its security and availability in the event of unintended deletion or modification is paramou...
Security is paramount when setting up resources in the cloud or on-premises. It encompasses various layers of protection, including network security, encrypt...
null_resource with local-exec and remote-exec in Terraform
Terraform, a widely adopted Infrastructure as Code (IaC) tool, offers a rich array of resources and provisioners for efficiently managing and configuring inf...
BigQuery, Google’s fully-managed and serverless data warehouse, empowers organizations to analyze massive datasets with remarkable speed and efficiency. But ...
Google BigQuery is a powerful and cost-effective data warehouse that enables you to analyze massive datasets quickly. However, to get the most out of BigQuer...
Managing resources in your Google Cloud Platform (GCP) projects is a complex task, especially when dealing with multiple projects. Fortunately, Google offers...
In this blog post we will be setting up a postgres database on docker using Dockerfile.
Python virtual environment creates a isoloated workspace of python work. This helps in creating project specific virtual environment without worrying about ...
In this blog post we will be setting up a postgres database on docker.
List Comprehensions provides easy and functional way to create list in python. We could make a single line of code which otherwise would take a few lines. l...
Python is a clear and powerful object-oriented programming language, comparable to Perl, Ruby, Scheme, or Java. This is basic documentation for getting star...
neo4j_doc_manager.
We had a requirement where we wanted to have all the data which is in mongodb to be replicated on neo4j to show few graphs. Here is quick way to demonstrate ...
pyyaml [Python]
PyYAML - The next generation YAML parser and emitter for Python.
I was working on getting post headers for my post on this blog. I had couple of images from unsplash. But the header for the post need to be a little more ho...
python 2.7.x on Centos 6.5/6.6
CentOS 6 was distributed with Python 2.6, while some older applications require Python 2.7. This guide describes two historical installation approaches: usin...
This script can be used to monitor Namenode Parameters. This script can be used to Generate Zabbix Import XML or Send monitoring data to Zabbix server.
This section describes how to get monitoring data from Zabbix server through the command line and export these to a CSV formatted file.
This script is to create a xml import file from a csv file. We use 2 csv file for this.
Send Zabbix metric by reading from a XML file. This needs package zbxsend from : https://github.com/ahmedzbyr/zbxsend
Easy way to collect files recursively over a sftp server is to connect to the server over scp and do scp -r. Problem was that the device we were connecting ...
Apache Kafka is often described as a distributed, fault-tolerant, high-throughput publish-subscribe messaging system. Think of it as a central nervous system...
parted.
GUID Partition Table (GPT) is a standard for the layout of the partition table on a physical hard disk, using globally unique identifiers (GUID). Although it...
In this blog post, we will venture into exporting data from Firestore and Datastore modes. Find the code on Github.
Data is invaluable, and as any developer would testify, ensuring its security and availability in the event of unintended deletion or modification is paramou...
Apache Kafka is a distributed streaming platform. Kafka 2.0 supports Kerberos authentication, Enabling Kerberos Authentication Using the Wizard on cloudera m...
Deployment error during setting zookeeper on a new cluster using Cloudera Manager UI, when an earlier cluster containing zookeeper earlier was built using Cl...
We were deploying one of the cluster on our lab environment which is used by everyone. So the lab has it own share of stale information on it.
We had a cluster environment which we needed to update the /etc/hosts file. Which would help communicate between the server over a private network. Our serve...
Nginx with Heartbeat - A Step-by-Step Guide
In today’s digital landscape, ensuring high availability for your web applications is paramount. Downtime can lead to lost revenue, damaged reputation, and ...
mod_jk and httpd on CentOS - In-Memory Session Replication - A Deep Dive
In a previous post, we explored a basic session-based replication setup for SpagoBI. However, that configuration lacked true session redundancy.
NGINX is a powerful and versatile open-source software that excels as an HTTP server, reverse proxy, and IMAP/POP3 proxy server. Renowned for its high perfo...
knife is the command-line tool that bridges your local chef-repo on a Chef Workstation and the Chef Infra Server. It allows administrators to manage nodes, c...
Migrating Nagios XI to a new server is straightforward using its built-in backup_xi.sh and restore_xi.sh utilities. Once the backup archive is restored onto ...
Nagios XI monitors hosts, network services, and application metrics across Linux and Windows environments, alerting administrators when checks enter warning ...
RPM (RPM Package Manager) is the low-level package management system used across Red Hat Enterprise Linux (RHEL), CentOS, Rocky Linux, AlmaLinux, Fedora, and...
Setting up yum repos on RHEL using httpd. We will be setting up httpd and yum repo on top of it. So that we can access yum over http.
SSSD can use an LDAP filter to decide which directory users are allowed to log in to a Linux host. This is useful when accounts should remain visible in the ...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
ansible on RHEL 6.6.
Ansible is a radically simple IT automation engine that automates cloud provisioning, configuration management, application deployment, intra-service orchest...
You can enter a linux system without entring a password using below steps. We will be creating a ssh jey which will be share between the servers, which will ...
The Apache Cassandra database is the right choice when you need scalability and high availability without compromising performance. Linear scalability and pr...
Kernel-based Virtual Machine (KVM) has become a cornerstone of Linux server virtualization, known for its maturity and performance. Red Hat’s decision to fav...
zabbix-java-gateway on Centos 6.5
Zabbix 2.0 introduced native support for monitoring JMX applications through the Zabbix Java gateway. This Java-based daemon acts as an intermediary, allowin...
Node.js is an open-source, cross-platform JavaScript runtime environment that executes JavaScript code server-side. It’s incredibly popular for building scal...
This script provides a simple way to create users on CentOS/RHEL 6.5 systems from the command line. It allows you to create both normal and sudo (administrat...
This guide walks you through configuring a High Availability (HA) Apache web server using Heartbeat on CentOS/RHEL 6. HA ensures your web server remains acce...
sudo effective uid is not 0 Error on Linux
Encountered a frustrating issue on a Linux server while trying to use sudo? Specifically, the error message: sudo: effective uid is not 0, is sudo installed ...
This guide demonstrates how to build a Node.js application that receives JSON data via HTTP and routes it to different Apache Kafka topics based on the URL p...
RPM (RPM Package Manager) is the low-level package management system used across Red Hat Enterprise Linux (RHEL), CentOS, Rocky Linux, AlmaLinux, Fedora, and...
RRDtool (Round Robin Database) stores time-series performance metrics (such as Nagios / PNP4Nagios / Cacti / Zabbix / Ganglia graphs) in a binary file format...
Was setting up jekyll using docker, but was not able to install ruby on the docker machine as apt-add-repository was not working. Below is my Dockerfile when...
TL;DR In this post we will be setting up a scheduled job to take backup for Bigtable table in avro format.
This script provides a simple way to create users on CentOS/RHEL 6.5 systems from the command line. It allows you to create both normal and sudo (administrat...
Easy way to collect files recursively over a sftp server is to connect to the server over scp and do scp -r. Problem was that the device we were connecting ...
The System Security Services Daemon (SSSD) provides a set of daemons to manage access to remote directories and authentication mechanisms. It provides Name S...
SSSD can use an LDAP filter to decide which directory users are allowed to log in to a Linux host. This is useful when accounts should remain visible in the ...
Apache Hive is a powerful data warehousing application built on top of Hadoop; it enables you to access your data using Hive QL, a language that is similar t...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
sudo effective uid is not 0 Error on Linux
Encountered a frustrating issue on a Linux server while trying to use sudo? Specifically, the error message: sudo: effective uid is not 0, is sudo installed ...
sysctl.conf for Web and FTP Servers
The sysctl interface provides a powerful way to modify the behavior of a running Linux kernel. By editing the /etc/sysctl.conf file, you can persistently co...
Apache HBase is a powerful NoSQL database, but out-of-the-box, it’s a bit like a house with no locks on the doors. Any user who can connect to the cluster ca...
Changing the timezone on your Ubuntu server is a crucial task for ensuring accurate timekeeping, especially when dealing with scheduled tasks, logs, and appl...
sudo effective uid is not 0 Error on Linux
Encountered a frustrating issue on a Linux server while trying to use sudo? Specifically, the error message: sudo: effective uid is not 0, is sudo installed ...
Easy way to collect files recursively over a sftp server is to connect to the server over scp and do scp -r. Problem was that the device we were connecting ...
Tsung (formerly known as idx-Tsunami) is a powerful, open-source, multi-protocol distributed load testing tool. Written in Erlang, it’s licensed under the GP...
Kernel 2.6, x86_64 - A Comprehensive Guide
Siege is a powerful, open-source HTTP load testing and benchmarking utility. It’s designed to help web developers and system administrators measure the perfo...
postgres and mysql.
Regular database backups are essential after deploying a Zabbix monitoring server. Depending on your recovery requirements and disk capacity, you can take ei...
There might be situations where you have a remote/zabbix server which does not have internet connectivity, due to security or other reasons. So we create a ...
In zabbix we dont have a better way to capture snmptraps. we have to manually create an item and corresponfding trigger to handle a trap arriving from the de...
zabbix-extra on Zabbix Version 2.4.
SNMP Builder/Extra is an add-in for Zabbix. It provides new web interface components to browse MIB trees and values. SNMP OIDs can then be automatically conv...
Receiving SNMP traps is the opposite to querying SNMP-enabled devices. In this case the information is sent from a SNMP-enabled device and is collected or “t...
The SpagoBI project is a free software/open source initiative by the SpagoBI Labs of Engineering Group. It aims to realize the most complete 100% open source...
This post details how to set up a Tomcat cluster for SpagoBI 5.1, building upon a previous guide for installing SpagoBI with MySQL (post). This configuration...
mod_jk and httpd on CentOS - In-Memory Session Replication - A Deep Dive
In a previous post, we explored a basic session-based replication setup for SpagoBI. However, that configuration lacked true session redundancy.
This post details how to set up a Tomcat cluster for SpagoBI 5.1, building upon a previous guide for installing SpagoBI with MySQL (post). This configuration...
The SpagoBI project is a free software/open source initiative by the SpagoBI Labs of Engineering Group. It aims to realize the most complete 100% open source...
Apache Spark is an in-memory distributed data analysis platform– primarily targeted at speeding up batch analysis jobs, iterative machine learning jobs, inte...
Cloud SQL is a fully managed service which includes MySQL, PostgreSQL, Microsoft SQL Server. And for horizontal scalability, consider using Cloud Spanner.
squid as a sibling to an already existing Parent squid.
Squid is a caching and forwarding web proxy. It has a wide variety of uses, from speeding up a web server by caching repeated requests; to caching web, DNS a...
Configuring HTTPS (TLS/SSL) on a Nagios XI server encrypts web UI logins, API calls (/nagiosxi/api/v1/), and passive check submissions (/nrdp/). Enabling HTT...
The System Security Services Daemon (SSSD) provides a set of daemons to manage access to remote directories and authentication mechanisms. It provides Name S...
SSSD can use an LDAP filter to decide which directory users are allowed to log in to a Linux host. This is useful when accounts should remain visible in the ...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
There are inherent structural differences between how Windows and Linux handle system users. The user schemas used in Active Directory and standard LDAPv3 di...
The System Security Services Daemon (SSSD) provides a set of daemons to manage access to remote directories and authentication mechanisms. It provides Name S...
This comprehensive guide explains how to assign multiple IP addresses to a single network interface in Linux. This technique, often called IP aliasing or cre...
Cloud Storage is Google Cloud’s object storage service, and it allows worldwide storage and retrieval of any amount of data at anytime.
This is a simple Storm Cluster Setup. We are using a dedicated Zookeeper Cluster/Node, instead of the standalone zkserver. Below is how we will deploy our c...
Apache Spark is an in-memory distributed data analysis platform– primarily targeted at speeding up batch analysis jobs, iterative machine learning jobs, inte...
sudo effective uid is not 0 Error on Linux
Encountered a frustrating issue on a Linux server while trying to use sudo? Specifically, the error message: sudo: effective uid is not 0, is sudo installed ...
Swappiness is a crucial Linux kernel parameter that dictates how aggressively the system uses swap space. Understanding and configuring swappiness can signif...
Swappiness is a crucial Linux kernel parameter that dictates how aggressively the system uses swap space. Understanding and configuring swappiness can signif...
Getting HBase to perform well in a production environment is an iterative process that involves tweaking various configuration parameters. This post dives de...
Node.js, Nginx
This post provides a detailed sysctl.conf file, optimized for Linux systems running high-performance web servers like Nginx and Node.js applications. The sy...
sysctl.conf for Web and FTP Servers
The sysctl interface provides a powerful way to modify the behavior of a running Linux kernel. By editing the /etc/sysctl.conf file, you can persistently co...
sysctl.conf
This post delves into optimizing Hadoop performance at the kernel level using sysctl. The sysctl interface provides a way to dynamically modify a running Lin...
Swappiness is a crucial Linux kernel parameter that dictates how aggressively the system uses swap space. Understanding and configuring swappiness can signif...
Ansible is a powerful automation tool that allows you to manage and configure infrastructure as code. Back when we were running 100s of hadoop nodes these we...
Changing the timezone on your Ubuntu server is a crucial task for ensuring accurate timekeeping, especially when dealing with scheduled tasks, logs, and appl...
tarball.
Setting up Hadoop using Ansible, we will be using cdh5 tarball for installation of the cluster.
Infrastructure as Code (IaC) has revolutionized how we manage and provision infrastructure. Tools like Terraform allow us to define our infrastructure in cod...
Terraform Cloud Functions Cloud Monitoring.
This blog post demonstrates how to automate Firestore health checks using Terraform to deploy a Cloud Function (Gen 1) and set up a complete monitoring and a...
Welcome back to our series on datastream workflows! In our previous article, we explored the basics of setting up a datastream workflow.
This guide provides detailed instructions on setting up a datastream connection from Cloud SQL (MySQL) to BigQuery. We aim to simplify the process by using d...
We will walk you through the process of setting up HashiCorp Vault to effectively manage your secrets. This guide is an gettinf started with vault with terra...
Data is invaluable, and as any developer would testify, ensuring its security and availability in the event of unintended deletion or modification is paramou...
Ensuring consistency and streamlining infrastructure provisioning is crucial for effective cloud management. Creating custom virtual machine (VM) images on G...
Using Ansible within the initialization script of a Google Compute Engine (GCE) instance can streamline and automate the configuration and setup of your virt...
Security is paramount when setting up resources in the cloud or on-premises. It encompasses various layers of protection, including network security, encrypt...
null_resource with local-exec and remote-exec in Terraform
Terraform, a widely adopted Infrastructure as Code (IaC) tool, offers a rich array of resources and provisioners for efficiently managing and configuring inf...
BigQuery, Google’s fully-managed and serverless data warehouse, empowers organizations to analyze massive datasets with remarkable speed and efficiency. But ...
Google BigQuery is a powerful and cost-effective data warehouse that enables you to analyze massive datasets quickly. However, to get the most out of BigQuer...
Managing resources in your Google Cloud Platform (GCP) projects is a complex task, especially when dealing with multiple projects. Fortunately, Google offers...
null_resource
When working with Terraform, it’s crucial to ensure that your infrastructure follows certain conditions or constraints. While Terraform provides validation m...
Validation in Terraform is an essential practice to detect and prevent errors early in the infrastructure provisioning process. By incorporating robust valid...
Kerberos authentication in Google Dataproc clusters offers enhanced security and user isolation. It’s a crucial step for multi-tenancy, encryption, and user ...
TL;DR In this post we will be setting up a scheduled job to take backup for Bigtable table in avro format.
Infrastructure as Code (IaC) has revolutionized how we manage and provision infrastructure. Tools like Terraform allow us to define our infrastructure in cod...
Infrastructure as Code (IaC) has revolutionized how we manage and provision infrastructure. Tools like Terraform allow us to define our infrastructure in cod...
These are a set of testing which we can do on a Hadoop environment. These are basic testing to make sure the environment is setup correctly.
Test Kitchen (kitchen-vagrant) can provision disposable Microsoft Windows Server virtual machines on a Linux or macOS workstation using VirtualBox, Vagrant, ...
Tsung (formerly known as idx-Tsunami) is a powerful, open-source, multi-protocol distributed load testing tool. Written in Erlang, it’s licensed under the GP...
Kernel 2.6, x86_64 - A Comprehensive Guide
Siege is a powerful, open-source HTTP load testing and benchmarking utility. It’s designed to help web developers and system administrators measure the perfo...
Changing the timezone on your Ubuntu server is a crucial task for ensuring accurate timekeeping, especially when dealing with scheduled tasks, logs, and appl...
The SpagoBI project is a free software/open source initiative by the SpagoBI Labs of Engineering Group. It aims to realize the most complete 100% open source...
mod_jk and httpd on CentOS - In-Memory Session Replication - A Deep Dive
In a previous post, we explored a basic session-based replication setup for SpagoBI. However, that configuration lacked true session redundancy.
This post details how to set up a Tomcat cluster for SpagoBI 5.1, building upon a previous guide for installing SpagoBI with MySQL (post). This configuration...
postgres and mysql.
Regular database backups are essential after deploying a Zabbix monitoring server. Depending on your recovery requirements and disk capacity, you can take ei...
There might be situations where you have a remote/zabbix server which does not have internet connectivity, due to security or other reasons. So we create a ...
In zabbix we dont have a better way to capture snmptraps. we have to manually create an item and corresponfding trigger to handle a trap arriving from the de...
zabbix-extra on Zabbix Version 2.4.
SNMP Builder/Extra is an add-in for Zabbix. It provides new web interface components to browse MIB trees and values. SNMP OIDs can then be automatically conv...
Receiving SNMP traps is the opposite to querying SNMP-enabled devices. In this case the information is sent from a SNMP-enabled device and is collected or “t...
Ansible is a powerful automation tool that simplifies infrastructure management and application deployment. However, like any technology, it’s easy to make m...
Not Enough Physical Memory Error in VMware Workstation 10 on Windows 8.1
Are you encountering the frustrating “Not enough physical memory is available to power this virtual machine” error in VMware Workstation 10 after a Windows u...
Unable to locate package oracle-java7-installer on Ubuntu
I recently ran into a frustrating issue while trying to install Java 7 on an older Ubuntu system (Ubuntu 13, in this case). The seemingly simple command sud...
sudo effective uid is not 0 Error on Linux
Encountered a frustrating issue on a Linux server while trying to use sudo? Specifically, the error message: sudo: effective uid is not 0, is sudo installed ...
Tsung (formerly known as idx-Tsunami) is a powerful, open-source, multi-protocol distributed load testing tool. Written in Erlang, it’s licensed under the GP...
Node.js, Nginx
This post provides a detailed sysctl.conf file, optimized for Linux systems running high-performance web servers like Nginx and Node.js applications. The sy...
sysctl.conf for Web and FTP Servers
The sysctl interface provides a powerful way to modify the behavior of a running Linux kernel. By editing the /etc/sysctl.conf file, you can persistently co...
sysctl.conf
This post delves into optimizing Hadoop performance at the kernel level using sysctl. The sysctl interface provides a way to dynamically modify a running Lin...
nginx
Nginx (pronounced “engine x”) is a powerful and versatile web server renowned for its high concurrency, exceptional performance, and efficient memory utiliza...
Node.js is an open-source, cross-platform JavaScript runtime environment that executes JavaScript code server-side. It’s incredibly popular for building scal...
Test Kitchen (kitchen-vagrant) can provision disposable Microsoft Windows Server virtual machines on a Linux or macOS workstation using VirtualBox, Vagrant, ...
When monitoring MongoDB 3.x instances from Nagios XI using the built-in check_mongodb.py plugin (originally written for MongoDB 2.x and older versions of pym...
Apache CouchDB is an open-source, document-oriented NoSQL database that stores JSON documents, exposes a native HTTP/RESTful API (on TCP port 5984 by default...
MongoDB is a document-oriented NoSQL database that stores records as BSON (binary JSON) documents with flexible schemas and rich indexing. This guide covers ...
Chef Data Bags store global JSON data on the Chef Infra Server that can be queried by any cookbook or node. When storing sensitive data—such as user password...
Automated log cleanup and backup rotation scripts on Linux frequently rely on GNU find to locate and delete files older than a retention threshold. Evaluatin...
RRDtool (Round Robin Database) stores time-series performance metrics (such as Nagios / PNP4Nagios / Cacti / Zabbix / Ganglia graphs) in a binary file format...
YARN - A Detailed Guide for Ubuntu 12.04 LTS
HBase is a powerful open-source, non-relational, distributed database designed for handling massive datasets. Inspired by Google’s BigTable, HBase is written...
Unable to locate package oracle-java7-installer on Ubuntu
I recently ran into a frustrating issue while trying to install Java 7 on an older Ubuntu system (Ubuntu 13, in this case). The seemingly simple command sud...
Changing the timezone on your Ubuntu server is a crucial task for ensuring accurate timekeeping, especially when dealing with scheduled tasks, logs, and appl...
The Java Development Kit (JDK) is an essential tool for Java developers, providing the necessary components to compile, debug, and run Java applications. Whi...
Upgrading Cloudera Manager 5 to the Latest Cloudera Manager, In most cases it is possible to complete the following upgrade without shutting down most CDH se...
Ensuring the health and availability of your Firestore database is crucial for maintaining a reliable application. This post provides a Python script that se...
This script provides a simple way to create users on CentOS/RHEL 6.5 systems from the command line. It allows you to create both normal and sudo (administrat...
We will walk you through the process of setting up HashiCorp Vault to effectively manage your secrets. This guide is an gettinf started with vault with terra...
Kernel-based Virtual Machine (KVM) has become a cornerstone of Linux server virtualization, known for its maturity and performance. Red Hat’s decision to fav...
This comprehensive guide explains how to assign multiple IP addresses to a single network interface in Linux. This technique, often called IP aliasing or cre...
Kernel-based Virtual Machine (KVM) has become a cornerstone of Linux server virtualization, known for its maturity and performance. Red Hat’s decision to fav...
Not Enough Physical Memory Error in VMware Workstation 10 on Windows 8.1
Are you encountering the frustrating “Not enough physical memory is available to power this virtual machine” error in VMware Workstation 10 after a Windows u...
Kernel-based Virtual Machine (KVM) has become a cornerstone of Linux server virtualization, known for its maturity and performance. Red Hat’s decision to fav...
Not Enough Physical Memory Error in VMware Workstation 10 on Windows 8.1
Are you encountering the frustrating “Not enough physical memory is available to power this virtual machine” error in VMware Workstation 10 after a Windows u...
NGINX is a powerful and versatile open-source software that excels as an HTTP server, reverse proxy, and IMAP/POP3 proxy server. Renowned for its high perfo...
Are you ready to dive into the world of automation? Ansible is a powerful tool that allows you to manage and configure systems with ease. This blog post will...
Setting up yum repos on RHEL using httpd. We will be setting up httpd and yum repo on top of it. So that we can access yum over http.
This blog post provides a comprehensive, step-by-step guide to integrating NodeJS with Kafka. Whether you’re building real-time data pipelines, implementing ...
This guide demonstrates how to build a Node.js application that receives JSON data via HTTP and routes it to different Apache Kafka topics based on the URL p...
kafka-node
Ready to integrate your NodeJS application with Kafka? This post provides a comprehensive guide to setting up a Kafka producer using the kafka-node library. ...
This post outlines how to send JSON data from a client (browser or curl) through a NodeJS server and ultimately into a Kafka topic. This architecture is usef...
Node.js is an open-source, cross-platform JavaScript runtime environment that executes JavaScript code server-side. It’s incredibly popular for building scal...
Node.js, Nginx
This post provides a detailed sysctl.conf file, optimized for Linux systems running high-performance web servers like Nginx and Node.js applications. The sy...
sysctl.conf for Web and FTP Servers
The sysctl interface provides a powerful way to modify the behavior of a running Linux kernel. By editing the /etc/sysctl.conf file, you can persistently co...
Pandoc is an open-source universal document converter capable of transforming technical documentation written in Markdown into PDF, Microsoft Word (.docx), H...
Test Kitchen (kitchen-vagrant) can provision disposable Microsoft Windows Server virtual machines on a Linux or macOS workstation using VirtualBox, Vagrant, ...
When working on a Windows machine after spending years in Linux, Cygwin provides a POSIX-compatible environment where your custom .bashrc and .vimrc configur...
The knife-windows plugin extends Chef’s knife CLI with subcommands to bootstrap and manage Microsoft Windows nodes over Windows Remote Management (WinRM) or ...
The local hosts file maps IP addresses to hostnames (FQDNs and short aliases) on the local machine before querying external DNS servers. This is especially u...
When testing disk-space monitoring alerts (such as Nagios or Zabbix filesystem thresholds), network throughput, or backup performance, it is helpful to quick...
Developing and testing Chef cookbooks locally on a Windows workstation requires three core components: the Chef Development Kit (ChefDK) (since superseded by...
Not Enough Physical Memory Error in VMware Workstation 10 on Windows 8.1
Are you encountering the frustrating “Not enough physical memory is available to power this virtual machine” error in VMware Workstation 10 after a Windows u...
This script can be used to monitor Namenode Parameters. This script can be used to Generate Zabbix Import XML or Send monitoring data to Zabbix server.
Send Zabbix metric by reading from a XML file. This needs package zbxsend from : https://github.com/ahmedzbyr/zbxsend
YARN distcp.
Usually distcp and other batch jobs run for a very long time. This is fine if you are running a HADOOP environment without kerberos. When we kerberize a clus...
distcp.
When you see this error default thing to do is the set the HADOOP_CLIENT_OPTS config on your env. In My case did a typo HADDOP_CLIENT_OPTS which caused us sp...
Getting HBase to perform well in a production environment is an iterative process that involves tweaking various configuration parameters. This post dives de...
YARN - A Detailed Guide for Ubuntu 12.04 LTS
HBase is a powerful open-source, non-relational, distributed database designed for handling massive datasets. Inspired by Google’s BigTable, HBase is written...
Setting up yum repos on RHEL using httpd. We will be setting up httpd and yum repo on top of it. So that we can access yum over http.
After migrating or restoring a Nagios XI server, navigating to the Servicegroup Summary, Hostgroup Summary, or legacy Nagios Core CGI views may fail with one...
In large Zabbix deployments, the raw history tables (history, history_uint, history_str, history_log, and history_text) frequently grow to tens or hundreds o...
postgres and mysql.
Regular database backups are essential after deploying a Zabbix monitoring server. Depending on your recovery requirements and disk capacity, you can take ei...
There might be situations where you have a remote/zabbix server which does not have internet connectivity, due to security or other reasons. So we create a ...
In zabbix we dont have a better way to capture snmptraps. we have to manually create an item and corresponfding trigger to handle a trap arriving from the de...
zabbix-extra on Zabbix Version 2.4.
SNMP Builder/Extra is an add-in for Zabbix. It provides new web interface components to browse MIB trees and values. SNMP OIDs can then be automatically conv...
Receiving SNMP traps is the opposite to querying SNMP-enabled devices. In this case the information is sent from a SNMP-enabled device and is collected or “t...
zabbix-java-gateway on Centos 6.5
Zabbix 2.0 introduced native support for monitoring JMX applications through the Zabbix Java gateway. This Java-based daemon acts as an intermediary, allowin...
Zabbix is the ultimate enterprise-level software designed for monitoring availability and performance of IT infrastructure components. Zabbix is open source ...
This script can be used to monitor Namenode Parameters. This script can be used to Generate Zabbix Import XML or Send monitoring data to Zabbix server.
This section describes how to get monitoring data from Zabbix server through the command line and export these to a CSV formatted file.
This script is to create a xml import file from a csv file. We use 2 csv file for this.
Send Zabbix metric by reading from a XML file. This needs package zbxsend from : https://github.com/ahmedzbyr/zbxsend
Module used to generate Zabbix import xml for snmp traps, Below are steps to create a Zabbix Import for Traps. These traps are captured from the snmptrap fun...
zabbix-java-gateway on Centos 6.5
Zabbix 2.0 introduced native support for monitoring JMX applications through the Zabbix Java gateway. This Java-based daemon acts as an intermediary, allowin...
Send Zabbix metric by reading from a XML file. This needs package zbxsend from : https://github.com/ahmedzbyr/zbxsend
Deployment error during setting zookeeper on a new cluster using Cloudera Manager UI, when an earlier cluster containing zookeeper earlier was built using Cl...
This is the second follow up post. In the earlier post
This is the second follow up post. In the earlier post Setting Up Cloudera Manager Services Using Cloudera API [Part 1] we install the cloudera management se...
tarball.
This is a simple zookeeper playbook, to quickly start zookeeper running on a single or more nodes, in a clustered mode.
This is a simple Storm Cluster Setup. We are using a dedicated Zookeeper Cluster/Node, instead of the standalone zkserver. Below is how we will deploy our c...
This is a simple Kafka setup. In this setup we are running kafka over a dedicated zookeeper service. (NOT the standalone zookeeper which comes with kafka)