TeamCity CI Config

TeamCity CI configurations, synchronized from my automated TeamCity cluster.

TeamCity configuration

• .teamcity/ - XML format live sync'd
• exports/ - JSON exports using API scripts in DevOps Bash tools repo
• kotlin/ - Kotlin exports from UI
• .teamcity.vcs.oauth.json - VCS connection to this repo via OAuth
• .teamcity.vcs.ssh.json - VCS connection to this repo via SSH key

teamcity.sh - one-shot TeamCity cluster on Docker with automated agent authorization and VCS integration via API calls.

TeamCity on Docker - docker-compose.yml

TeamCity on Kubernetes configurations are here.

Automation

• Kubernetes configs - extensive Kubernetes configurations, including TeamCity-on-Kubernetes & Jenkins-on-Kubernetes, plus advanced templates for most major kubernetes objects

• DevOps Bash tools:

  • teamcity.sh - launches a TeamCity cluster in Docker
    • auto-loads VCS with all the builds
  • teamcity_api.sh - query the TeamCity API, handling authentication and other details
  • jenkins.sh - one-touch Jenkins CI instance in Docker
    • auto-loads and builds a pipeline from Jenkinsfile
  • concourse.sh - one-touch Concourse CI instance in Docker
    • auto-loads and builds a pipeline from .concourse.yml
  • gocd.sh - one-touch GoCD CI cluster in Docker
    • auto-loads and builds a pipeline from a config repo

See Also

• Templates - templates for many CI systems, code and configs eg. advanced Jenkinsfile & Jenkins Shared Library (Groovy), GitHub Actions, Travis CI, CircleCI, AWS CodeBuild, GCP Cloud Build, Makefile, Vagrantfile, Dockerfile, docker-compose.yml etc.

• Advanced Nagios Plugins - 450+ production monitoring checks including for the Jenkins API

CI Systems

All my major GitHub repos contain fully working live configs for most major CI system out there.

See CI/CD notes in my public Knowledge Base for more details and comparisons between different CI/CD systems.

Local CI

You can boot any of these CI and run the repo's build with a single short one-word command using the scripts above.

• Jenkins - Jenkinsfile at the top of each repo
• Concourse - .concourse.yml at the top of each repo
• GoCD - setup/gocd_config_repo.json in each repo
• TeamCity - .teamcity.vcs.oauth.json / .teamcity.vcs.ssh.json connection to this repo

Hosted CI

• AppVeyor
• AWS CodeBuild
• Azure DevOps Pipelines
• BitBucket Pipelines
• Buddy
• BuildKite
• Circle CI
• Cirrus CI
• CodeShip
• Codefresh
• Drone.io
• GCP Cloud Build
• GitHub Actions Workflows
• GitLab CI
• Semaphore CI
• Shippable
• Travis CI

Related Repositories

• Jenkins - Advanced Jenkinsfile & Jenkins Shared Library

• GitHub-Actions - GitHub Actions master template & GitHub Actions Shared Workflows library

• DevOps Bash Tools - 1000+ DevOps Bash Scripts, Advanced .bashrc, .vimrc, .screenrc, .tmux.conf, .gitconfig, CI configs & Utility Code Library - AWS, GCP, Kubernetes, Docker, Kafka, Hadoop, SQL, BigQuery, Hive, Impala, PostgreSQL, MySQL, LDAP, DockerHub, Jenkins, Spotify API & MP3 tools, Git tricks, GitHub API, GitLab API, BitBucket API, Code & build linting, package management for Linux / Mac / Python / Perl / Ruby / NodeJS / Golang, and lots more random goodies

• SQL Scripts - 100+ SQL Scripts - PostgreSQL, MySQL, AWS Athena, Google BigQuery

• Kubernetes configs - Kubernetes YAML configs - Best Practices, Tips & Tricks are baked right into the templates for future deployments

• Terraform - Terraform templates for AWS / GCP / Azure / GitHub management

• DevOps Python Tools - 80+ DevOps CLI tools for AWS, GCP, Hadoop, HBase, Spark, Log Anonymizer, Ambari Blueprints, AWS CloudFormation, Linux, Docker, Spark Data Converters & Validators (Avro / Parquet / JSON / CSV / INI / XML / YAML), Elasticsearch, Solr, Travis CI, Pig, IPython

• DevOps Perl Tools - 25+ DevOps CLI tools for Hadoop, HDFS, Hive, Solr/SolrCloud CLI, Log Anonymizer, Nginx stats & HTTP(S) URL watchers for load balanced web farms, Dockerfiles & SQL ReCaser (MySQL, PostgreSQL, AWS Redshift, Snowflake, Apache Drill, Hive, Impala, Cassandra CQL, Microsoft SQL Server, Oracle, Couchbase N1QL, Dockerfiles, Pig Latin, Neo4j, InfluxDB), Ambari FreeIPA Kerberos, Datameer, Linux...

• The Advanced Nagios Plugins Collection - 450+ programs for Nagios monitoring your Hadoop & NoSQL clusters. Covers every Hadoop vendor's management API and every major NoSQL technology (HBase, Cassandra, MongoDB, Elasticsearch, Solr, Riak, Redis etc.) as well as message queues (Kafka, RabbitMQ), continuous integration (Jenkins, Travis CI) and traditional infrastructure (SSL, Whois, DNS, Linux)

• Nagios Plugin Kafka - Kafka API pub/sub Nagios Plugin written in Scala with Kerberos support

• HAProxy Configs - 80+ HAProxy Configs for Hadoop, Big Data, NoSQL, Docker, Elasticsearch, SolrCloud, HBase, Cloudera, Hortonworks, MapR, MySQL, PostgreSQL, Apache Drill, Hive, Presto, Impala, ZooKeeper, OpenTSDB, InfluxDB, Prometheus, Kibana, Graphite, SSH, RabbitMQ, Redis, Riak, Rancher etc.

• Dockerfiles - 50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Mesos, Consul, Riak, OpenTSDB, Jython, Advanced Nagios Plugins & DevOps Tools repos on Alpine, CentOS, Debian, Fedora, Ubuntu, Superset, H2O, Serf, Alluxio / Tachyon, FakeS3

• HashiCorp Packer templates - Linux automated bare-metal installs and portable virtual machines OVA format appliances using HashiCorp Packer, Redhat Kickstart, Debian Preseed and Ubuntu AutoInstaller / Cloud-Init

• Diagrams-as-Code - Cloud & Open Source architecture diagrams with Python & D2 source code provided - automatically regenerated via GitHub Actions CI/CD - AWS, GCP, Kubernetes, Jenkins, ArgoCD, Traefik, Kong API Gateway, Nginx, Redis, PostgreSQL, Kafka, Spark, web farms, event processing...