{"id":58714,"date":"2026-08-31T08:02:00","date_gmt":"2026-08-30T22:02:00","guid":{"rendered":"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/"},"modified":"2026-08-31T08:03:17","modified_gmt":"2026-08-30T22:03:17","slug":"azure-event-hubs-large-messages-when-to-redesign-your-architecture","status":"publish","type":"post","link":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/","title":{"rendered":"Azure Event Hubs Large Messages When to Redesign Your Architecture"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">In this blog post Azure Event Hubs Large Messages When to Redesign Your Architecture we will explain why oversized events cause cost, reliability and performance problems, even when Azure technically allows them.<\/p>\n\n\n\n<!--more-->\n\n\n\n<p class=\"wp-block-paragraph\">The warning signs are familiar. An integration works well during testing, then production data grows. Messages start failing, processing slows down and the proposed fix is to increase limits, add capacity or split payloads into chunks.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Sometimes that fix is reasonable. In other cases, the message-size error is telling you that Event Hubs is being asked to carry something it was not designed to carry.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What Azure Event Hubs actually does<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Azure Event Hubs is a real-time data streaming service. Applications and devices publish a continuous stream of small events, while one or more receiving systems read and process that stream independently.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Think of it as a fast-moving conveyor belt. Each event should usually describe something that happened, such as an order being placed, a device changing status or an AI agent completing a task.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Event Hubs divides the stream into partitions, which are separate lanes that allow data to be processed at scale. Events within each partition are read in order, so one unusually large or slow event can delay the work behind it.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What counts as a large Event Hubs message<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Message limits depend on the Azure Event Hubs tier. At the time of writing, Basic supports publications up to 256 KB, while Standard and Premium support up to 1 MB. Eligible Dedicated clusters can support messages up to 20 MB, although large-message support is currently a preview feature.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The limit applies to the complete publication, including message content and associated data. A batch of events must also fit within the permitted publication size.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">However, the service limit should not be your only design test. A 700 KB event may be technically valid in Standard, but it can still become expensive when sent thousands of times per hour and read by several consumer applications.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Why simply increasing the limit may not solve the problem<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">1. Large events consume capacity quickly<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Event Hubs capacity is affected by both the number of events and the amount of data moving through the service. Larger messages use more network bandwidth, take longer to process and require more memory in receiving applications.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The impact multiplies when several consumers read the same stream. A 5 MB payload read by six systems can create far more data movement than the sending application suggests.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">2. Failures become more expensive<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Event-driven systems must assume that processing will occasionally fail. When a consumer retries a large message, the application must download, decode and process the entire payload again.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This increases recovery time and can create a backlog during an outage. What begins as one failed integration can delay reporting, customer notifications and other business processes using the same stream.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">3. Every consumer receives data it may not need<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">An event may contain a document, image, AI conversation or detailed business record even though most consumers only need an identifier and status.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Sending the full object forces every system to handle sensitive or unnecessary data. That increases processing costs and creates more places where confidential information must be secured.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">4. A tier upgrade can hide the underlying design issue<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Moving to an Event Hubs Dedicated cluster may be justified when the business needs very high throughput, predictable performance and dedicated capacity. It is harder to justify when the only reason is that one application sends oversized documents.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The business may end up paying for a larger platform to avoid changing one integration. Before approving that cost, compare it with storing the payload separately and sending a lightweight event.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The better pattern for files and large business objects<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">When an event contains a large document, image, export file or AI-generated artefact, the usual alternative is the claim-check pattern. Despite the technical name, the idea is simple.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The application stores the large payload in Azure Blob Storage or Azure Data Lake Storage. It then sends a small Event Hubs message containing the location, identifier, version and basic processing instructions.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>{\n &amp;quot;eventType&amp;quot;: &amp;quot;CustomerDocumentReady&amp;quot;,\n &amp;quot;documentId&amp;quot;: &amp;quot;DOC-10482&amp;quot;,\n &amp;quot;storagePath&amp;quot;: &amp;quot;customer-documents\/DOC-10482.json&amp;quot;,\n &amp;quot;contentType&amp;quot;: &amp;quot;application\/json&amp;quot;,\n &amp;quot;createdUtc&amp;quot;: &amp;quot;2026-08-30T09:30:00Z&amp;quot;,\n &amp;quot;correlationId&amp;quot;: &amp;quot;PROCESS-7281&amp;quot;\n}<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">Consumers that need the document retrieve it from storage. Consumers that only need to update a dashboard, create an alert or record an audit entry can use the small event without downloading the file.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Access should be controlled through managed identities, which allow Azure services to authenticate without passwords stored in code. Avoid placing permanent storage credentials or long-lived access links inside the event.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">You also need rules for retention, deletion, versioning and failed processing. Otherwise, storage can gradually fill with payloads that are no longer required.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">When breaking the event into smaller events makes sense<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Sometimes the payload is large because it combines several business events into one object. For example, an application may publish an entire customer record whenever only an address, account status or preference has changed.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Publishing smaller events such as <code>CustomerAddressChanged<\/code> or <code>AccountStatusUpdated<\/code> reduces data movement and allows each consumer to respond only to relevant changes.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This is particularly important in AI systems. An AI agent should not send its complete conversation history, retrieved documents and generated files through Event Hubs every time it hands work to another agent.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Send the task status, references and approved output instead. Our guides to hub-and-spoke architecture for AI agents and monitoring agent-to-agent communication in Azure explain how this structure improves control and troubleshooting.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Why message chunking should be a last resort<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Splitting a 10 MB payload into smaller pieces can get around a size limit, but it creates new problems. Chunks may arrive late, be processed twice or be read in the wrong order if partitioning is not handled carefully.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The receiving application must track every piece, rebuild the original payload and decide what to do when one piece is missing. This adds code, support effort and failure points.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Chunking can be appropriate when there is no separate storage option and strict streaming is required. For most business documents and AI payloads, the claim-check pattern is simpler and more reliable.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">A practical business scenario<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Consider a 200-person professional services company sending completed case files through Event Hubs. Each file contains metadata, notes, attachments and an AI-generated summary, producing messages between 2 MB and 8 MB.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Upgrading infrastructure would allow the messages to pass, but every reporting, compliance and notification consumer would still receive the full file. Retries would remain slow, and sensitive data would continue travelling to systems that did not need it.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A redesigned model stores each case file securely in Blob Storage and publishes a small <code>CaseFileCompleted<\/code> event. Reporting receives the case number and completion time, while the compliance application retrieves the full file using its own controlled identity.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The business outcome is lower data movement, faster processing, simpler retries and tighter control over sensitive information. It also becomes easier to prove who accessed each document during an audit.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Five questions to ask before changing your Event Hubs tier<\/h2>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Is the payload genuinely an event, or is it a file being transported through an event stream?<\/li>\n<li>Do all consumers need the complete payload?<\/li>\n<li>What happens to processing time and cost when the message is retried?<\/li>\n<li>Are we considering Dedicated because of overall scale, or only because one message exceeds 1 MB?<\/li>\n<li>Could Blob Storage, Data Lake Storage or smaller business events achieve the same outcome more safely?<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">Also test with real production-sized data. Compression can help in some cases, but it should not be the only plan because compression rates vary and decompression adds processing work.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Design for the business outcome<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Large-message support in Azure Event Hubs is useful when events cannot reasonably be divided or stored elsewhere. It should be treated as an informed architecture choice, not an automatic response to a failed publication.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For Australian organisations, separating large payloads from events can also strengthen access control, monitoring and incident investigation. These measures support broader security and compliance programs alongside Essential Eight, the Australian Government&#8217;s recommended cybersecurity framework.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">CloudProInc brings more than 20 years of enterprise IT experience to these decisions. As a Melbourne-based Microsoft Partner and Wiz Security Integrator, we help organisations examine Azure integrations across performance, security, support effort and long-term cost rather than treating each limit as an isolated technical problem.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If large Event Hubs messages are causing failures or pushing you towards an expensive tier upgrade, we are happy to review the design and explain the practical options. No strings attached.<\/p>\n\n\n","protected":false},"excerpt":{"rendered":"<p>Larger Event Hubs limits can solve an immediate problem, but they may hide a costly architecture issue. Learn when to increase capacity and when to redesign.<\/p>\n","protected":false},"author":1,"featured_media":58716,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_yoast_wpseo_opengraph-title":"Large Messages: When to Redesign Your Architecture","_yoast_wpseo_opengraph-description":"Large messages can raise streaming costs, delay processing and expose excess data. Learn when separate storage or smaller events provide a better design.","_yoast_wpseo_twitter-title":"Large Messages: When to Redesign Your Architecture","_yoast_wpseo_twitter-description":"Large messages can raise streaming costs, delay processing and expose excess data. Learn when separate storage or smaller events provide a better design.","_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[76,16,13,124],"tags":[],"class_list":["post-58714","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-application-development","category-microsoft-azure","category-blog","category-cloud-cost-finops"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.3 (Yoast SEO v28.3) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Large Messages: When to Redesign Your Architecture<\/title>\n<meta name=\"description\" content=\"Large messages can raise streaming costs, delay processing and expose excess data. Learn when separate storage or smaller events provide a better design.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Large Messages: When to Redesign Your Architecture\" \/>\n<meta property=\"og:description\" content=\"Large messages can raise streaming costs, delay processing and expose excess data. Learn when separate storage or smaller events provide a better design.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/\" \/>\n<meta property=\"og:site_name\" content=\"CPI Consulting\" \/>\n<meta property=\"article:published_time\" content=\"2026-08-30T22:02:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-08-30T22:03:17+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cloudproinc.azurewebsites.net\/wp-content\/uploads\/2026\/08\/azure-event-hubs-large-messages-when-to-redesign-your-architecture.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1536\" \/>\n\t<meta property=\"og:image:height\" content=\"1024\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"CPI Staff\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"Large Messages: When to Redesign Your Architecture\" \/>\n<meta name=\"twitter:description\" content=\"Large messages can raise streaming costs, delay processing and expose excess data. Learn when separate storage or smaller events provide a better design.\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"CPI Staff\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2026\\\/08\\\/31\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2026\\\/08\\\/31\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\\\/\"},\"author\":{\"name\":\"CPI Staff\",\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/#\\\/schema\\\/person\\\/192eeeb0ce91062126ce3822ae88fe6e\"},\"headline\":\"Azure Event Hubs Large Messages When to Redesign Your Architecture\",\"datePublished\":\"2026-08-30T22:02:00+00:00\",\"dateModified\":\"2026-08-30T22:03:17+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2026\\\/08\\\/31\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\\\/\"},\"wordCount\":1394,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2026\\\/08\\\/31\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\\\/#primaryimage\"},\"thumbnailUrl\":\"\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture.png\",\"articleSection\":[\"Application Development\",\"Azure\",\"Blog\",\"Cloud Cost &amp; FinOps\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2026\\\/08\\\/31\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2026\\\/08\\\/31\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\\\/\",\"url\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2026\\\/08\\\/31\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\\\/\",\"name\":\"Large Messages: When to Redesign Your Architecture\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2026\\\/08\\\/31\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2026\\\/08\\\/31\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\\\/#primaryimage\"},\"thumbnailUrl\":\"\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture.png\",\"datePublished\":\"2026-08-30T22:02:00+00:00\",\"dateModified\":\"2026-08-30T22:03:17+00:00\",\"description\":\"Large messages can raise streaming costs, delay processing and expose excess data. Learn when separate storage or smaller events provide a better design.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2026\\\/08\\\/31\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2026\\\/08\\\/31\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2026\\\/08\\\/31\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\\\/#primaryimage\",\"url\":\"\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture.png\",\"contentUrl\":\"\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture.png\",\"width\":1536,\"height\":1024},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2026\\\/08\\\/31\\\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Azure Event Hubs Large Messages When to Redesign Your Architecture\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/#website\",\"url\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/\",\"name\":\"Cloud Pro Inc - CPI Consulting Pty Ltd\",\"description\":\"Cloud, AI &amp; Cybersecurity Consulting | Melbourne\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/#organization\",\"name\":\"Cloud Pro Inc - Cloud Pro Inc - CPI Consulting Pty Ltd\",\"url\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"\\\/wp-content\\\/uploads\\\/2022\\\/01\\\/favfinalfile.png\",\"contentUrl\":\"\\\/wp-content\\\/uploads\\\/2022\\\/01\\\/favfinalfile.png\",\"width\":500,\"height\":500,\"caption\":\"Cloud Pro Inc - Cloud Pro Inc - CPI Consulting Pty Ltd\"},\"image\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/#\\\/schema\\\/person\\\/192eeeb0ce91062126ce3822ae88fe6e\",\"name\":\"CPI Staff\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2d96eeb53b791d92c8c50dd667e3beec92c93253bb6ff21c02cfa8ca73665c70?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2d96eeb53b791d92c8c50dd667e3beec92c93253bb6ff21c02cfa8ca73665c70?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2d96eeb53b791d92c8c50dd667e3beec92c93253bb6ff21c02cfa8ca73665c70?s=96&d=mm&r=g\",\"caption\":\"CPI Staff\"},\"sameAs\":[\"http:\\\/\\\/www.cloudproinc.com.au\"],\"url\":\"https:\\\/\\\/cloudproinc.azurewebsites.net\\\/index.php\\\/author\\\/cpiadmin\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Large Messages: When to Redesign Your Architecture","description":"Large messages can raise streaming costs, delay processing and expose excess data. Learn when separate storage or smaller events provide a better design.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/","og_locale":"en_US","og_type":"article","og_title":"Large Messages: When to Redesign Your Architecture","og_description":"Large messages can raise streaming costs, delay processing and expose excess data. Learn when separate storage or smaller events provide a better design.","og_url":"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/","og_site_name":"CPI Consulting","article_published_time":"2026-08-30T22:02:00+00:00","article_modified_time":"2026-08-30T22:03:17+00:00","og_image":[{"width":1536,"height":1024,"url":"https:\/\/cloudproinc.azurewebsites.net\/wp-content\/uploads\/2026\/08\/azure-event-hubs-large-messages-when-to-redesign-your-architecture.png","type":"image\/png"}],"author":"CPI Staff","twitter_card":"summary_large_image","twitter_title":"Large Messages: When to Redesign Your Architecture","twitter_description":"Large messages can raise streaming costs, delay processing and expose excess data. Learn when separate storage or smaller events provide a better design.","twitter_misc":{"Written by":"CPI Staff","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/#article","isPartOf":{"@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/"},"author":{"name":"CPI Staff","@id":"https:\/\/www.cloudproinc.com.au\/#\/schema\/person\/192eeeb0ce91062126ce3822ae88fe6e"},"headline":"Azure Event Hubs Large Messages When to Redesign Your Architecture","datePublished":"2026-08-30T22:02:00+00:00","dateModified":"2026-08-30T22:03:17+00:00","mainEntityOfPage":{"@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/"},"wordCount":1394,"commentCount":0,"publisher":{"@id":"https:\/\/www.cloudproinc.com.au\/#organization"},"image":{"@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/#primaryimage"},"thumbnailUrl":"\/wp-content\/uploads\/2026\/08\/azure-event-hubs-large-messages-when-to-redesign-your-architecture.png","articleSection":["Application Development","Azure","Blog","Cloud Cost &amp; FinOps"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/","url":"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/","name":"Large Messages: When to Redesign Your Architecture","isPartOf":{"@id":"https:\/\/www.cloudproinc.com.au\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/#primaryimage"},"image":{"@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/#primaryimage"},"thumbnailUrl":"\/wp-content\/uploads\/2026\/08\/azure-event-hubs-large-messages-when-to-redesign-your-architecture.png","datePublished":"2026-08-30T22:02:00+00:00","dateModified":"2026-08-30T22:03:17+00:00","description":"Large messages can raise streaming costs, delay processing and expose excess data. Learn when separate storage or smaller events provide a better design.","breadcrumb":{"@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/#primaryimage","url":"\/wp-content\/uploads\/2026\/08\/azure-event-hubs-large-messages-when-to-redesign-your-architecture.png","contentUrl":"\/wp-content\/uploads\/2026\/08\/azure-event-hubs-large-messages-when-to-redesign-your-architecture.png","width":1536,"height":1024},{"@type":"BreadcrumbList","@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2026\/08\/31\/azure-event-hubs-large-messages-when-to-redesign-your-architecture\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.cloudproinc.com.au\/"},{"@type":"ListItem","position":2,"name":"Azure Event Hubs Large Messages When to Redesign Your Architecture"}]},{"@type":"WebSite","@id":"https:\/\/www.cloudproinc.com.au\/#website","url":"https:\/\/www.cloudproinc.com.au\/","name":"Cloud Pro Inc - CPI Consulting Pty Ltd","description":"Cloud, AI &amp; Cybersecurity Consulting | Melbourne","publisher":{"@id":"https:\/\/www.cloudproinc.com.au\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.cloudproinc.com.au\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.cloudproinc.com.au\/#organization","name":"Cloud Pro Inc - Cloud Pro Inc - CPI Consulting Pty Ltd","url":"https:\/\/www.cloudproinc.com.au\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.cloudproinc.com.au\/#\/schema\/logo\/image\/","url":"\/wp-content\/uploads\/2022\/01\/favfinalfile.png","contentUrl":"\/wp-content\/uploads\/2022\/01\/favfinalfile.png","width":500,"height":500,"caption":"Cloud Pro Inc - Cloud Pro Inc - CPI Consulting Pty Ltd"},"image":{"@id":"https:\/\/www.cloudproinc.com.au\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.cloudproinc.com.au\/#\/schema\/person\/192eeeb0ce91062126ce3822ae88fe6e","name":"CPI Staff","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/2d96eeb53b791d92c8c50dd667e3beec92c93253bb6ff21c02cfa8ca73665c70?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/2d96eeb53b791d92c8c50dd667e3beec92c93253bb6ff21c02cfa8ca73665c70?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2d96eeb53b791d92c8c50dd667e3beec92c93253bb6ff21c02cfa8ca73665c70?s=96&d=mm&r=g","caption":"CPI Staff"},"sameAs":["http:\/\/www.cloudproinc.com.au"],"url":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/author\/cpiadmin\/"}]}},"jetpack-related-posts":[{"id":53744,"url":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/2025\/08\/31\/extracting-structured-data-with-openai\/","url_meta":{"origin":58714,"position":0},"title":"Extracting Structured Data with OpenAI","author":"CPI Staff","date":"August 31, 2025","format":false,"excerpt":"Turn messy text into clean JSON using OpenAI. Learn schema design, prompting, validation, and code patterns for reliable extraction at scale.","rel":"","context":"In &quot;AI&quot;","block_context":{"text":"AI","link":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/category\/ai\/"},"img":{"alt_text":"","src":"\/wp-content\/uploads\/2025\/08\/extracting-structured-data-with-openai.png","width":350,"height":200,"srcset":"\/wp-content\/uploads\/2025\/08\/extracting-structured-data-with-openai.png 1x, \/wp-content\/uploads\/2025\/08\/extracting-structured-data-with-openai.png 1.5x, \/wp-content\/uploads\/2025\/08\/extracting-structured-data-with-openai.png 2x, \/wp-content\/uploads\/2025\/08\/extracting-structured-data-with-openai.png 3x, \/wp-content\/uploads\/2025\/08\/extracting-structured-data-with-openai.png 4x"},"classes":[]},{"id":58491,"url":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/2026\/08\/17\/a-practical-azure-front-door-mutual-tls-playbook-for-b2b-apis\/","url_meta":{"origin":58714,"position":1},"title":"A Practical Azure Front Door Mutual TLS Playbook for B2B APIs","author":"CPI Staff","date":"August 17, 2026","format":false,"excerpt":"Learn how Azure Front Door mutual TLS can block unknown systems, strengthen partner API security, and reduce the operational risk of certificate-based B2B integrations.","rel":"","context":"In &quot;Azure&quot;","block_context":{"text":"Azure","link":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/category\/microsoft-azure\/"},"img":{"alt_text":"","src":"\/wp-content\/uploads\/2026\/08\/a-practical-azure-front-door-mutual-tls-playbook-for-b2b-apis.png","width":350,"height":200,"srcset":"\/wp-content\/uploads\/2026\/08\/a-practical-azure-front-door-mutual-tls-playbook-for-b2b-apis.png 1x, \/wp-content\/uploads\/2026\/08\/a-practical-azure-front-door-mutual-tls-playbook-for-b2b-apis.png 1.5x, \/wp-content\/uploads\/2026\/08\/a-practical-azure-front-door-mutual-tls-playbook-for-b2b-apis.png 2x, \/wp-content\/uploads\/2026\/08\/a-practical-azure-front-door-mutual-tls-playbook-for-b2b-apis.png 3x, \/wp-content\/uploads\/2026\/08\/a-practical-azure-front-door-mutual-tls-playbook-for-b2b-apis.png 4x"},"classes":[]},{"id":53832,"url":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/2025\/09\/15\/manage-android-byod-with-microsoft-intune\/","url_meta":{"origin":58714,"position":2},"title":"Manage Android BYOD with Microsoft Intune","author":"CPI Staff","date":"September 15, 2025","format":false,"excerpt":"A practical guide to securing personal Android devices with Intune work profiles, app protection, and Conditional Access\u2014without invading employee privacy.","rel":"","context":"In &quot;Blog&quot;","block_context":{"text":"Blog","link":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/category\/blog\/"},"img":{"alt_text":"","src":"\/wp-content\/uploads\/2025\/09\/manage-android-byod-with-microsoft-intune-using-work-profile.png","width":350,"height":200,"srcset":"\/wp-content\/uploads\/2025\/09\/manage-android-byod-with-microsoft-intune-using-work-profile.png 1x, \/wp-content\/uploads\/2025\/09\/manage-android-byod-with-microsoft-intune-using-work-profile.png 1.5x, \/wp-content\/uploads\/2025\/09\/manage-android-byod-with-microsoft-intune-using-work-profile.png 2x, \/wp-content\/uploads\/2025\/09\/manage-android-byod-with-microsoft-intune-using-work-profile.png 3x, \/wp-content\/uploads\/2025\/09\/manage-android-byod-with-microsoft-intune-using-work-profile.png 4x"},"classes":[]},{"id":57049,"url":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/2026\/02\/18\/what-essential-8-compliance-actually-means-for-your-business\/","url_meta":{"origin":58714,"position":3},"title":"What Essential 8 Compliance Actually Means for Your Business","author":"CPI Staff","date":"February 18, 2026","format":false,"excerpt":"Essential 8 isn\u2019t a checkbox. It\u2019s a practical way to reduce ransomware risk, prove due diligence, and avoid expensive security \u201csurprises\u201d as your business grows.","rel":"","context":"In &quot;Blog&quot;","block_context":{"text":"Blog","link":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/category\/blog\/"},"img":{"alt_text":"","src":"\/wp-content\/uploads\/2026\/02\/post-27.png","width":350,"height":200,"srcset":"\/wp-content\/uploads\/2026\/02\/post-27.png 1x, \/wp-content\/uploads\/2026\/02\/post-27.png 1.5x, \/wp-content\/uploads\/2026\/02\/post-27.png 2x, \/wp-content\/uploads\/2026\/02\/post-27.png 3x, \/wp-content\/uploads\/2026\/02\/post-27.png 4x"},"classes":[]},{"id":57695,"url":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/2026\/06\/28\/conditional-access-gaps-that-put-business-accounts-at-risk-today\/","url_meta":{"origin":58714,"position":4},"title":"Conditional Access Gaps That Put Business Accounts at Risk Today","author":"CPI Staff","date":"June 28, 2026","format":false,"excerpt":"Conditional Access can stop account attacks before they become breaches, but only if it is designed, tested, and maintained properly.","rel":"","context":"In &quot;Blog&quot;","block_context":{"text":"Blog","link":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/category\/blog\/"},"img":{"alt_text":"","src":"\/wp-content\/uploads\/2026\/06\/conditional-access-gaps-that-put-business-accounts-at-risk-today.png","width":350,"height":200,"srcset":"\/wp-content\/uploads\/2026\/06\/conditional-access-gaps-that-put-business-accounts-at-risk-today.png 1x, \/wp-content\/uploads\/2026\/06\/conditional-access-gaps-that-put-business-accounts-at-risk-today.png 1.5x, \/wp-content\/uploads\/2026\/06\/conditional-access-gaps-that-put-business-accounts-at-risk-today.png 2x, \/wp-content\/uploads\/2026\/06\/conditional-access-gaps-that-put-business-accounts-at-risk-today.png 3x, \/wp-content\/uploads\/2026\/06\/conditional-access-gaps-that-put-business-accounts-at-risk-today.png 4x"},"classes":[]},{"id":53812,"url":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/2025\/09\/14\/mastering-docker-environment-variables-with-docker\/","url_meta":{"origin":58714,"position":5},"title":"Mastering Docker environment variables with Docker","author":"CPI Staff","date":"September 14, 2025","format":false,"excerpt":"Learn how to manage configuration with Docker and Compose using environment variables, from build-time and runtime to .env files, secrets, precedence, and pitfalls. Practical steps and examples included.","rel":"","context":"In &quot;Blog&quot;","block_context":{"text":"Blog","link":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/category\/blog\/"},"img":{"alt_text":"","src":"\/wp-content\/uploads\/2025\/09\/mastering-docker-environment-variables-with-docker-compose-today.png","width":350,"height":200,"srcset":"\/wp-content\/uploads\/2025\/09\/mastering-docker-environment-variables-with-docker-compose-today.png 1x, \/wp-content\/uploads\/2025\/09\/mastering-docker-environment-variables-with-docker-compose-today.png 1.5x, \/wp-content\/uploads\/2025\/09\/mastering-docker-environment-variables-with-docker-compose-today.png 2x, \/wp-content\/uploads\/2025\/09\/mastering-docker-environment-variables-with-docker-compose-today.png 3x, \/wp-content\/uploads\/2025\/09\/mastering-docker-environment-variables-with-docker-compose-today.png 4x"},"classes":[]}],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"\/wp-content\/uploads\/2026\/08\/azure-event-hubs-large-messages-when-to-redesign-your-architecture.png","_links":{"self":[{"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/posts\/58714","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/comments?post=58714"}],"version-history":[{"count":1,"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/posts\/58714\/revisions"}],"predecessor-version":[{"id":58715,"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/posts\/58714\/revisions\/58715"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/media\/58716"}],"wp:attachment":[{"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/media?parent=58714"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/categories?post=58714"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/tags?post=58714"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}