StackOps
- From Q2 FY25, updates that were previously listed under Monitoring are now listed under Resiliency to better reflect its purpose and capabilities.
- CloudSCAPE, one of the tools previously under Monitoring, is now grouped under Cloud.
StackOps FY25
| Q1FY25 | Q2FY25 | Q3FY25 |
|---|---|---|
| Driving customer success - CFT Transforms Operations – from reactive to proactive: Discover how Cloud File Transfer (CFT) leveraged StackOps to move from reactive troubleshooting to proactive, data-driven operations. With real-time visibility across 1,500+ critical workflows, CFT has slashed incident handling time by 75% (from 2-3 hours to just 30 minutes), ensuring consistent service quality. - Check out how HTX leveraged StackOps to unify observability, empower development teams, and enhance security and sustainability across their cloud journey. New and enhanced features - StackOps Observability Accelerator (SOA) has been enhanced to support: - High Availability (HA) support for Elastic Agent makes your observability setup more resilient. - Expanded AWS service support makes it easier to ingest data across a broader range of cloud resources. - AI/Large Language Models (LLM)-based inference automatically enriches your Bill of Materials (BOM) data, improving insights and analysis. - Enhanced CIS Benchmark dashboard shows more detailed results from the latest scans, helping you better understand your compliance posture. - Simplified deployment management: Users can now delete deployments directly from the TechBiz portal with Subscription Admin’s approval. - StackOps schema & aggregations StackOps schema extends the Elastic Common Schema (ECS), making it easier for tenants to profile their data and search across deployments. You can also leverage aggregations to determine the profiling for your data more effectively. Documentation updates - AI-Powered BOM Enrichment: Harness the power of Large Language Models to automatically enrich your Bill of Materials (BOM) data with key vulnerability and service data — accelerating risk management and insights. Read to understand how to set up your own ingestion pipeline with an inference processor. - Seamless Jira & Elastic integration: The Elastic Jira connector integrates Jira with the Elastic Stack (e.g. Elasticsearch, Kibana), making it easier for you to visualise Jira data on Elastic. Read our Elastic Jira connector documentation to configure your Elastic Jira connector. - Manage Watermark Limits: Without proactive ILP management, tenants risk hitting limits causing data ingestion or query failures. We have published our Long term approach for Watermark limits to help maintain system reliability. Users are encouraged to review and update Index Lifecycle Policies (ILP) to avoid watermark limit issues, ensuring smooth data transitions. We have enriched our documentation with the following use cases: - Sharing data across clusters - Migrating data in Elasticsearch - Sanitising data - How to review audit trails - Derive optimisation insights through profiling - Learning resources: Recording of StackOps 101 workshop has been segmented into 8 chapters for you to quickly access specific topics. - Upcoming changes - As communicated on 2 July, StackOps pricing will begin from 1 September 2025. For more details, refer to StackOps pricing documentation. |
- StackOps pricing & invoice verification: StackOps pricing has begun, and invoices can be reviewed in Console. Review your invoice and raise any issues promptly to ensure billing accuracy. Resources such as cost optimisation guides, pricing calculators are available to help teams manage costs. We also conducted and support sessions and clinics for our users. - Updated StackOps Roadmap for FY 2025. Feedback can be sent to enquiries_CEP@tech.gov.sg, helping shape upcoming initiatives and priorities. - StackOps Elasticsearch v8.19: Elasticsearch version 8.19 is now available for upgrade. This release brings key improvements for performance, observability, and reliability. Users can request upgrades via the self-service interface once available. - StackOps Observability Accelerator (SOA): Following SOA enhancements improve monitoring and automation: - Azure support: Discover resources, verify diagnostic settings, track logs and metrics ingestion, generate BOMs, and visualise observability status in Kibana. - Automated agent deployment: Ensures high-availability log and metric collection in AWS. - Migration to Elastic Agent: Eliminates manual setup and ensures HA ingestion for logs and metrics. - Service Accounts & API Keys: Create deployment-level service accounts with predefined roles to enable secure automated access for CI/CD pipelines, monitoring agents, or custom applications. Service accounts can also generate API keys for seamless, secure integration with Elasticsearch. - Console - Central SGTS Subscription Platform: Console provides a unified interface for managing all SGTS products and workflows: - Subscribe, configure, and approve product access - Monitor activity logs and manage API keys - Create TechPass accounts and log support tickets directly This streamlines operations, improves efficiency, and reduces manual overhead for administrators. - RBAC Management via APIs: Automate Role-Based Access Control in StackOps using APIs and manage API keys via Console, reducing manual tasks and improving governance. - Optimise costs for central view deployments: Central view deployments are read-only and ideal for optimisation. Users can remove unused nodes, right-size resources, and scale based on actual usage to reduce costs. - Security enhancements: - Mask AWS account IDs: The soa_llm_aws_bedrock pipeline now masks account IDs before sending prompts to the LLM. - SIEM rules for Azure: Enable cross-cloud threat detection with pre-mapped rules - SIEM shared exceptions: Centrally manage alert exceptions to reduce noise. - Customise alert messages: Tailor messages for Slack and Webhook connectors for faster incident response. - Tail-based sampling in Elastic APM: Provides finer control over trace sampling in high-volume systems, allowing teams to optimise performance monitoring without overwhelming system resources. - Preconfigured templates for custom roles: Preconfigured templates for Observability User, Security Read-only User, and Security User help teams save time and standardise role creation. - Customer success story: HDB successfully leveraged StackOps observability capabilities to monitor distributed cloud architecture, gaining comprehensive insights into application health and performance. |
Platform Self-service upgrade for deployments is now available: - As of 13 Nov 2025, self-service upgrade is supported from v8.12 onwards. 43% have used this feature within the first month. - All tenants must upgrade to Elasticsearch v8.19 by 30 January 2026, as support for older versions will be discontinued. If you are unable to perform a self-service upgrade, raise an SR. 83% have upgraded to v8.19 to date. StackOps Observability Accelerator (SOA) The following SOA enhancements are available for better automation and monitoring: - SOA synthetic checks—Automatically discover AWS resources (e.g. Route53 endpoints, URLs) and create synthetic checks in Kibana Synthetics to detect failures and performance issues early. - Wolfi-based Elastic Agent containers—More secure and lightweight container images for Elastic Agents, now automatically applied for versions > 8.17.1. - SOA EOL Software Detection—Monitors your infrastructure for software reaching the end-of-life (EOL) status and automatically sends alerts to upgrade. Enables active monitoring, reducing security risks while saving time. - Azure discover config file generation—Automatically discover Azure resources and generate configuration files for Elastic Agent deployment. Includes Bill of Materials (BOM) indexing for asset tracking. - Azure Elastic Agent creation—Support for deploying Elastic Agents on Azure Linux VMs or Azure Container Apps. Pre-built templates for automated deployment with artifact management across pipeline stages. - AWS-native implement command—New command to implement disabled or optional configurations discovered using soa discover aws-native.- Other improvements— - Preserve local config changes when generating BOMs with the new --skip-config-file flag.- Environment variables now support comma-separated values (e.g., for multiple subnet IDs). ML and AI - Machine Learning Anomaly Detection (MLAD)**—Use Elastic ML jobs to identify unusual data patterns and detect potential security threats and operational issues early on. Set up MLAD using pre-configured and custom jobs or set up MLAD with SIEM rules. - **AI Assistant—The AI Assistant is now available in StackOps Elastic. It integrates a Large Language Model (LLM) to help you analyse data, identify issues, and generate insights directly within Elastic. Key capabilities include: - Inline contextual insights explaining errors and suggesting fixes. - Chat interface for querying and visualising data using natural language. - Support for root cause analysis, performance investigation, and report generation. Compliance You can use StackOps as ABLR Equivalent for GovTech products: - StackOps offers comparable functionality to ABLR in fulfilling PMO (SNDGO) Circular Minute No:3/2021 IM8 requirements for automated monitoring and reporting of privileged user activities. - GovTech CIO Forum has approved StackOps as an ABLR-equivalent tool for GovTech products. Therefore, effective immediately, StackOps can be implemented in GovTech products without requiring individual waiver submissions. Except for GovTech, other agencies must still apply for an ABLR waiver, following their own approvals and processes. Documentation: - Refreshed SOA documentation—The SOA documentation has been updated for a better reading experience and easier navigation. - Authentication for synthetic tests—A new synthetic monitoring guide has been published, demonstrating how to set up authentication and manage credentials for synthetic tests. |
Archive
This section provides links to the quarterly updates of StackOps from previous financial years.
StackOps FY22
| Quarter | Update |
|---|---|
| Q4 FY22 | Base rules for SIEM are available for you to monitor products. |
| Q3 FY22 | Container Stack tenants can now use StackOps for tracking logs and traces. Contact StackOps to get started. |
| Q2 FY22 | Launched an easy onboarding for new users with StackOps Portal. Interested to get started? Write to stackops_sre@hive.gov.sg to contact StackOps. |
| Q1 FY22 | StackOps tenants can now use Elastic Cloud for monitoring, logging and tracing, and its inbuilt features like APM and SIEM. |
StackOps FY23
| Quarter | Update |
|---|---|
| Q4 FY23 | New features APEX API Dashboard: APEX API Dashboard is now available to APEX users on StackOps. This dashboard offers visualisations tailored for keeping a close eye on your APIs in your StackOps cluster, contributing to more efficient management and troubleshooting. Observability Accelerator - Alpha Release: Introducing StackOps Observability Accelerator to simplify the process of setting up cloud resources and deploying the Elastic Agent. Explore the current capabilities and share your valuable feedback with us. |
| Q3 FY23 | New features - Exciting news for Azure users: StackOps has expanded its monitoring capabilities to support Azure! - Synthetic monitoring: This monitoring strategy allows you to proactively monitor your website or API endpoints. For optimal cost efficiency and security, we strongly recommend using Private Locations for this. - Centralised SIEM Dashboard available at Innersource! This new centralised dashboard is designed to consolidate SIEM events from multiple systems/projects. The SIEM Dashboard empowers you to configure SIEM rules and alerts for proactive monitoring and improved observability. Enhanced features Change in Support Platform: New StackOps Service desk is available since Oct 2023 to improve the overall efficiency of customer support. |
| Q2 FY23 | New features - We have integrated with TechBiz to manage your StackOps subscriptions and provision Elastic deployments. - We have implemented baseline configurations to meet the WOG security compliance. - You can now monitor your clusters at your convenience using Stack Monitoring. Earlier you had to contact the StackOps team for this. |
| Q1 FY23 | New feature - InnerSource framework for SIEM rules is available for StackOps users to share and reuse existing SIEM rules. |
StackOps FY24
| Q1FY24 | Q2FY24 | Q3FY24 | Q4FY24 |
|---|---|---|---|
| New features - StackOps Observability Accelerator: This feature is developed to accelerate onboarding activities by discovering the type of resources in your cloud workloads, generating the configurations for the Elastic Agent to monitor them, and automates the implementation. For more information, watch our YouTube video. - Access and review audit logs: Audit logs in StackOps is now available to tenants to support their operation activities. We have simplified the access to these audit logs to your deployment via Cross-Cluster Capability. - New Alerts Dashboard: Have better understanding of the alerts generated by StackOps. - Hivemind Chatbot (Pilot): This bot is now available in pilot mode to answer your queries on StackOps. Documentation updates - FY24 Roadmap: Refer to this for our planned initiatives and improvements. - Updated Architecture: We have updated our architecture diagram to provide better understanding of your StackOps deployment cluster(s). - Cross-cluster capabilities: You can now leverage on unified search capabilities and data replication across StackOps subscriptions within the same or different organisations. This allows to create centralised dashboarding from different StackOps subscriptions and allow sharing of monitoring data between upstream & downstream dependencies. - Responsibility matrix: Understand who is responsible for each task or aspect of our service. - Integrate SIEM Alerts with GitLab: Leverage on GitLab for better management over SIEM Alerts generated from StackOps. This guide explains the setup to integrate your StackOps deployment with GitLab. |
New features - Transparency within GovTech: As part of the Open Data Access project, the new Dashboard viewer role enables GovTechies to view dashboards for projects within GovTech. This provides visibility and insights into various systems and applications within GovTech. - Application Performance Monitoring: Understand the APM tools supported by StackOps(OTel agent or Elastic APM agent) and how to instrument the APM agent on your StackOps deployment. APM provides a comprehensive end-to-end view and makes it easier for StackOps users to perform root cause analysis and quickly fix any performance problems. - Service Level Objectives (SLOs): The Site Reliability Engineering methodology empowers users to find the root cause and quickly recover when an issue occurs. SLOs are clear, measurable targets that help teams meet system performance goals. Users can now create and monitor SLOs for their applications with StackOps. Refer to this technical guide for more details. Enhanced features - Self-service traffic filter management: Tenants can now create and manage traffic filters directly from the DevConsole portal, instead of raising an SR. This reduces dependencies and delays by switching to a self-service model. - Upgraded capacity sizing: For all new deployments (XS and S), capacity has been increased to 4GB RAM and storage capacity has doubled. - More integrations for SOA: The StackOps Observability Accelerator (SOA) now supports additional integrations like DynamoDB metrics, EC2 metrics, RDS metrics, ECS metrics, and Lambda metrics. With the wider range of integrations, you can monitor their metrics efficiently! Significant documentation updates: - Added a quick start guide and revamped the documentation structure to simplify onboarding and improve usability for StackOps users. - New documentation for reviewing SIEM rules (enabling and disabling) to provide more flexibility. This will help users identify the SIEM rules relevant for them and troubleshoot erroneous rules. - Published the list of features and enhancements covered in Elasticsearch version 8.15. This helps users understand the benefits and also prepare them for an upcoming StackOps upgrade. - Updated configuration file example for deploying an Elastic serverless forwarder to cater to users with multiple logs. |
New features - Upgrade to Elasticsearch version 8.15.x: Upgrading your Elasticsearch version comes with added features and benefits that will ensure you enjoy the full features and capabilities of StackOps. - Real User Monitoring (RUM): You can now leverage RUM to track and measure your users’ actual experiences. Read our user guide to understand RUM, its importance, and how to install the Elastic RUM Agent. - Universal Profiling: Achieve complete system visibility when you use Universal Profiling to monitor every aspect of your application in an unobtrusive manner. Read our documentation to learn more about Universal Profiling, its benefits, and how to set it up for your StackOps deployments. - Monitoring SaaS with synthetic monitors: You can use synthetic monitors to monitor cloud-hosted or Software as a Service (SaaS) applications. Read Monitoring SaaS services using synthetics to learn how to create synthetic monitors to monitor the health of SaaS applications you may have in your application ecosystem. - Site Reliability Engineering (SRE): StackOps is conceptualised to help agencies adopt SRE practices, improving observability and resilience of your systems. Read the SRE and SLO pages to understand the differences between DevOps and SRE, how StackOps aids SRE practices, how to define SLOs on StackOps, and more. Enhanced features - Better insights with the StackOps Observability Accelerator (SOA) dashboard: With this dashboard, you can better visualise your Cloud resources and get more insights into your own Elasticsearch cluster like monitored and unmonitored resources, component breakdown at the resource level, and more. Read this guide to understand more. - Optimised resource management with the autoscaling feature: Autoscaling is now enabled for all new production deployments, enabling your infrastructure to adjust according to demand. Read this guide for more details. - More deployment insights on DevConsole: You can now access detailed deployment information on DevConsole like resource details, cluster version and scale, as well as traffic filters associated with your deployments. |
New features - Automated threat detection through SIEM: We’ve automated threat detection by leveraging SIEM rules and Indicators of Compromise (IoCs) to analyse past security events and identify patterns for future threat detection. - Custom role: This custom role feature enables StackOps tenants to segregate permissions for different user types and control access to their Kibana spaces from DevConsole. - Auditing SIEM actions: We’ve implemented security user schema to enable you to derive accurate insights on user actions and determine if all users have acknowledged security alerts; this is especially useful during regular log reviews and SIEM alert audits. - Video tutorials: We’ve collated a video library of StackOps tutorials and workshop recordings to make it easier for you to find a video, learn about a specific StackOps feature, or recap workshop topics. - APM and RUM: The video on the APM and RUM pages helps you instrument code for APM and set up Real User Monitoring.- Synthetic monitoring: The video shows how to create multistep monitors, use the Synthetics recorder to create Playwright scripts, alerts, and assertions. - StackOps 102 workshop: We’ve broken down the recording into 8 chapters for easy viewing. Jump straight into a specific topic or rewatch from the beginning of the playlist. - Endpoints metrics correlation dashboard: Check out this video to understand the components of the endpoints metrics correlation dashboard and how you can use it to correlate security and observability events. - Create custom dashboards: This video demonstrates how to create custom Kibana dashboards, the different graph types, how to use controls, and how to create reusable components. - How to read and access metrics and logs: This video explains how to create data views on Kibana to access your metrics and logs, how to filter and understand your data by using field statistics and patterns analysis. - How to configure alerts: This video shows you how to create different types of alert rules, configure alert connectors and messages, as well as how to access and interpret rule metrics. - Sizing and pricing: - StackOps - sizing and pricing: While pricing details are still undergoing approval, we have published an initial sizing and pricing guide to help you budget costs for StackOps. Note that we will share more details and exact timelines once pricing details are approved. - Elastic – sizing and costs: Once approved, StackOps pricing will depend on your Elastic consumption trends. Use the Elastic sizing and cost estimation guide (accessible via intranet) to understand how to estimate your ingest volume, accurately sizing your Elastic deployments, and other billing considerations. - Set up Azure Monitor Activity Log ingestion: The Azure Monitor Activity Log offers insights into events at the subscription level by collecting, analysing, and responding to monitoring data from your Azure cloud account. You can use these logs to detect changes within your system like modified resources or VMs, enabling you to discover and fix issues quickly. Enhanced features - StackOps Observability Accelerator (SOA)- GA: Now Generally Available, SOA accelerates and simplifies Elastic Agent deployments, making it easier for you to quickly create the minimum required Cloud resources for deploying Elastic Agents. - CI/CD workflow: By incorporating SOA stage templates to a CI/CD workflow, it is easier to manage resources and deployed Elastic Agents. - SOA graph: Leverage the SOA graph feature to visualise how entities are connected in your Bill of Materials and identify dependencies within your cluster.- Exclude central resources in discovery: SOA supports AWS Resources ignore capabilities with AWS tags. Simply label your resources with “soa:ignore=true” or define your own tag with the “–ignore-tags” flag, and they will be excluded from SOA config generation. - High Availability (HA) for data ingest: You can now generate Elastic Agent HA mode configurations using the “discover” command. Through these configurations, these Elastic Agents can leverage SQS metrics to automatically scale based on the SQS backlog, providing better performance for CPU and memory usage. - Types of application monitoring: StackOps currently supports several types of application monitoring to help you proactively identify potential issues and recover quickly. To understand and when you should use them, read types of application monitoring. - Stack monitoring: You can visualise monitoring data across your application stack and analyse past performance by leveraging Stack monitoring. |