{"id":53890,"date":"2025-09-18T10:38:02","date_gmt":"2025-09-18T00:38:02","guid":{"rendered":"https:\/\/www.cloudproinc.com.au\/?p=53890"},"modified":"2025-09-18T10:38:05","modified_gmt":"2025-09-18T00:38:05","slug":"the-autonomy-of-tensors","status":"publish","type":"post","link":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/","title":{"rendered":"The Autonomy of Tensors"},"content":{"rendered":"\n<p>In this blog post The Autonomy of Tensors for Smarter we will explore what gives tensors their \u201cautonomy,\u201d why it matters for both engineers and leaders, and how to put it to work in production.<\/p>\n\n\n\n<!--more-->\n\n\n\n<p><a href=\"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/08\/27\/what-are-tensors-in-ai-and-large-language-models-llms\/\">Tensors <\/a>are often described as multi\u2011dimensional arrays. That\u2019s true, but undersells them. In modern machine learning frameworks, tensors are also self\u2011describing and self\u2011directing data objects. They carry shape, type, device location, and transformation history. This lets runtimes place them on the right hardware, choose optimized kernels, and compute gradients\u2014largely without you micromanaging every step.<\/p>\n\n\n\n<p>The Autonomy of Tensors for Smarter, Faster ML Systems Today is about leaning into that capability. When you design your code to respect and leverage tensor metadata and dispatch rules, you get faster training, easier scaling, and fewer subtle bugs. Below we start high\u2011level, then dive into the core technologies and practical steps with small, focused examples.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-what-makes-a-tensor-autonomous\">What makes a tensor autonomous<\/h2>\n\n\n\n<p>Tensors manage more than values. They carry context that guides computation:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Shape and layout metadata. Broadcasting, strides, and views let operations align without copying data.<\/li>\n\n\n\n<li>Type and precision. Float16\/BFloat16 enable tensor cores; int8 supports quantized inference.<\/li>\n\n\n\n<li>Device placement. CPU, GPU, or TPU tags trigger kernel dispatch and memory movement.<\/li>\n\n\n\n<li>Autograd history. A dynamic or static computation graph records how to backpropagate gradients.<\/li>\n\n\n\n<li>Execution mode. Eager, traced, or compiled tensors pick different optimization paths at runtime.<\/li>\n<\/ul>\n\n\n\n<p>This self-knowledge is what we call autonomy: tensors \u201cknow\u201d enough about themselves\u2014and the operations around them\u2014to allow compilers and runtimes to make good decisions for performance and correctness.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-the-technology-behind-autonomous-tensors\">The technology behind autonomous tensors<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-kernel-dispatch-and-math-libraries\">Kernel dispatch and math libraries<\/h3>\n\n\n\n<p>When you call an operation, frameworks dispatch to vendor-tuned kernels based on tensor metadata:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>PyTorch ATen and TensorFlow ops route to cuDNN, cuBLAS, MKL, oneDNN, or custom CUDA\/ROCm kernels.<\/li>\n\n\n\n<li>Device tags and dtypes select specialized kernels (e.g., Tensor Cores for FP16\/BF16).<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-automatic-differentiation\">Automatic differentiation<\/h3>\n\n\n\n<p>Autograd records the computation path so gradients can be computed automatically. Dynamic graphs (PyTorch eager) are flexible; static graphs (XLA\/Graph mode) enable stronger compile-time optimizations. Either way, the tensor carries the breadcrumbs.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-graph-compilers-and-fusion\">Graph compilers and fusion<\/h3>\n\n\n\n<p>Modern stacks aggressively compile tensor programs:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>TorchInductor and nvFuser (PyTorch) fuse ops, remove overhead, and generate optimized kernels.<\/li>\n\n\n\n<li>XLA (JAX\/TF\/PyTorch-XLA) compiles graphs for CPUs, GPUs, and TPUs with memory planning.<\/li>\n\n\n\n<li>TVM and TensorRT handle model-specific codegen and inference acceleration.<\/li>\n<\/ul>\n\n\n\n<p>Fusion and layout-aware scheduling make tensors feel \u201cautonomous\u201d because the runtime rearranges work without altering your model\u2019s semantics.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-distributed-and-sharded-tensors\">Distributed and sharded tensors<\/h3>\n\n\n\n<p>Libraries like NCCL\/Gloo (collectives), Fully Sharded Data Parallel, and DTensor\/DeviceMesh partition tensors across devices and nodes. The same high-level code can run on a laptop GPU or a multi-node cluster simply by changing the device strategy.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-practical-ways-to-harness-tensor-autonomy\">Practical ways to harness tensor autonomy<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-1-start-eager-then-compile-hotspots\">1) Start eager, then compile hotspots<\/h3>\n\n\n\n<p>Eager mode is great for iteration. When stable, compile performance-critical sections.<\/p>\n\n\n\n<pre class=\"wp-block-code has-white-color has-black-background-color has-text-color has-background has-link-color wp-elements-0fd070cc6317fd09620ac8ac91bb0768\"><code># PyTorch example\nimport torch\n\nmodel = ...  # your module\nopt = torch.optim.Adam(model.parameters(), lr=3e-4)\n\n# Compile the model (PyTorch 2.x)\nmodel = torch.compile(model)  # torch._dynamo + TorchInductor\n\nfor x, y in dataloader:\n    pred = model(x)\n    loss = torch.nn.functional.mse_loss(pred, y)\n    opt.zero_grad()\n    loss.backward()\n    opt.step()\n<\/code><\/pre>\n\n\n\n<p>Tip: Keep tensor shapes steady in compiled regions to enable stronger specialization. If shapes vary, pad or bucket batches.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-2-declare-a-device-and-precision-policy\">2) Declare a device and precision policy<\/h3>\n\n\n\n<p>Let tensors \u201clive\u201d on the right device with a consistent precision policy. Mixed precision unlocks tensor cores while autocasting handles safe conversions.<\/p>\n\n\n\n<pre class=\"wp-block-code has-white-color has-black-background-color has-text-color has-background has-link-color wp-elements-a2e0a1ca53dbac44fbc457393ea534d9\"><code># Mixed precision with gradient scaling (PyTorch)\nfrom torch.cuda.amp import autocast, GradScaler\n\nscaler = GradScaler()\nmodel = model.to('cuda')\n\nfor x, y in dataloader:\n    x, y = x.cuda(non_blocking=True), y.cuda(non_blocking=True)\n    with autocast(dtype=torch.bfloat16):  # or torch.float16 on recent GPUs\n        pred = model(x)\n        loss = torch.nn.functional.cross_entropy(pred, y)\n    scaler.scale(loss).backward()\n    scaler.step(opt)\n    scaler.update()\n    opt.zero_grad(set_to_none=True)\n<\/code><\/pre>\n\n\n\n<p>Set a default dtype where appropriate (e.g., BF16 on Ampere+). Keep numerically sensitive layers (like final logits or losses) in FP32.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-3-embrace-broadcasting-but-verify-shapes\">3) Embrace broadcasting, but verify shapes<\/h3>\n\n\n\n<p>Broadcasting allows concise math but can explode memory if misused. Add assertions or explicit expansions.<\/p>\n\n\n\n<pre class=\"wp-block-code has-white-color has-black-background-color has-text-color has-background has-link-color wp-elements-b0b8a8a01020a4c9daf5838f969f1706\"><code>import torch\n\n# Safe broadcasting with checks\nlogits = torch.randn(32, 1000, device='cuda')\nbias   = torch.randn(1000, device='cuda')\nassert bias.shape == (1000,)\nlogits = logits + bias  # broadcast over batch\n\n# Guard against unintended expansion\nw = torch.randn(1, 1000, device='cuda')\nif w.shape&#91;0] == 1:\n    w = w.expand(logits.shape&#91;0], -1)  # explicit, zero-copy view\n<\/code><\/pre>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-4-respect-autograd-s-rules\">4) Respect autograd\u2019s rules<\/h3>\n\n\n\n<p>Autograd relies on the computation graph. In-place ops can sever it; detached tensors can silently stop grads.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Avoid in-place ops on tensors that require grad, unless you know the gradient formula is preserved.<\/li>\n\n\n\n<li>Use torch.no_grad() only around inference or metric computation.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-5-stream-your-input-pipeline\">5) Stream your input pipeline<\/h3>\n\n\n\n<p>Tensors are fast; starving them is not. Overlap data prep and transfers with compute.<\/p>\n\n\n\n<pre class=\"wp-block-code has-white-color has-black-background-color has-text-color has-background has-link-color wp-elements-63c5a813875b551d0ab1d8394f213928\"><code>from torch.utils.data import DataLoader\n\nloader = DataLoader(ds, batch_size=256, num_workers=8,\n                    pin_memory=True, prefetch_factor=4, persistent_workers=True)\n\nfor x, y in loader:\n    x = x.cuda(non_blocking=True)\n    y = y.cuda(non_blocking=True)\n    # ... compute\n<\/code><\/pre>\n\n\n\n<p>Pinning host memory and using non-blocking transfers let CUDA DMA run concurrently with kernels.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-6-use-distributed-strategies-that-match-your-model\">6) Use distributed strategies that match your model<\/h3>\n\n\n\n<p>Let the runtime scale tensors for you.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Data Parallel (DDP) for typical models.<\/li>\n\n\n\n<li>Fully Sharded Data Parallel (FSDP) or ZeRO for very large models that don\u2019t fit on one device.<\/li>\n\n\n\n<li>Pipeline or tensor parallel for extremely deep or wide models.<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-code has-white-color has-black-background-color has-text-color has-background has-link-color wp-elements-0a5226bf460bbbaedff3a52505d1581f\"><code># Minimal DDP launch example (torchrun)\n# torchrun --nproc_per_node=4 train.py\n\nimport torch.distributed as dist\nimport torch.nn as nn\nimport torch\nfrom torch.nn.parallel import DistributedDataParallel as DDP\n\ndef main():\n    dist.init_process_group('nccl')\n    rank = dist.get_rank()\n    torch.cuda.set_device(rank % torch.cuda.device_count())\n\n    model = nn.Linear(1024, 1024).cuda()\n    model = DDP(model, device_ids=&#91;torch.cuda.current_device()])\n    # ... training loop\n\nif __name__ == '__main__':\n    main()\n<\/code><\/pre>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-7-compile-or-export-for-inference\">7) Compile or export for inference<\/h3>\n\n\n\n<p>Tensors at inference time benefit from specialization and reduced precision.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Export to ONNX for broad runtimes.<\/li>\n\n\n\n<li>Use TensorRT, OpenVINO, or Torch\/TensorFlow compile paths for speed and memory wins.<\/li>\n\n\n\n<li>Quantize to INT8 where accuracy allows; calibrate with a representative dataset.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-how-autonomy-shows-up-in-day-to-day-work\">How autonomy shows up in day-to-day work<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Device-aware code. model.to(device) and input.to(device) ensure co-location. The dispatcher does the rest.<\/li>\n\n\n\n<li>Shape-safe APIs. Favor functions that infer shapes from metadata instead of hardcoding.<\/li>\n\n\n\n<li>Lazy evaluation. Some libraries delay materialization until needed, enabling fusion and memory planning.<\/li>\n\n\n\n<li>Zero-copy views. view, as_strided, and expand reuse storage without allocation.<\/li>\n\n\n\n<li><\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-closing-thoughts\">Closing thoughts<\/h2>\n\n\n\n<p>Tensors aren\u2019t just containers; they are active participants in your system. When you design for their autonomy\u2014metadata-aware code, careful broadcasting, consistent precision, and judicious compilation\u2014you unlock speed, scalability, and reliability without sacrificing clarity.<\/p>\n\n\n\n<p>If you\u2019d like help tuning training and inference stacks or setting principled tensor policies across teams, the experts at CloudProinc.com.au are ready to collaborate.<\/p>\n\n\n\n<ul class=\"wp-block-yoast-seo-related-links yoast-seo-related-links\">\n<li><a href=\"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/08\/27\/what-are-tensors-in-ai-and-large-language-models-llms\/\">What Are Tensors in AI and Large Language Models (LLMs)?<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/15\/loading-and-saving-pytorch-weights\/\">Loading and Saving PyTorch Weights<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/01\/publish-winui-app-to-windows-11-machines\/\">Publish WinUI App to Windows 11 Machines<\/a><\/li>\n\n\n\n<li><a href=\"null\">Automating Access to Microsoft Graph API Using Azure Pipelines<\/a><\/li>\n\n\n\n<li><a href=\"null\">Streamlining Office 365 Email Setup on Managed Devices with Microsoft Intune<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Tensors are more than arrays\u2014they carry rules, gradients, and placement hints. Learn how their autonomy drives speed and reliability, and how to harness it across training, inference, and scale.<\/p>\n","protected":false},"author":1,"featured_media":53891,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_yoast_wpseo_focuskw":"The Autonomy of Tensors","_yoast_wpseo_title":"","_yoast_wpseo_metadesc":"Explore The Autonomy of Tensors and its significance for engineers and leaders in modern machine learning frameworks.","_yoast_wpseo_opengraph-title":"","_yoast_wpseo_opengraph-description":"","_yoast_wpseo_twitter-title":"","_yoast_wpseo_twitter-description":"","_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[24,13,77],"tags":[],"class_list":["post-53890","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-blog","category-llm"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.3 (Yoast SEO v27.3) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>The Autonomy of Tensors - CPI Consulting<\/title>\n<meta name=\"description\" content=\"Explore The Autonomy of Tensors and its significance for engineers and leaders in modern machine learning frameworks.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Autonomy of Tensors\" \/>\n<meta property=\"og:description\" content=\"Explore The Autonomy of Tensors and its significance for engineers and leaders in modern machine learning frameworks.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/\" \/>\n<meta property=\"og:site_name\" content=\"CPI Consulting\" \/>\n<meta property=\"article:published_time\" content=\"2025-09-18T00:38:02+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-09-18T00:38:05+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cloudproinc.azurewebsites.net\/wp-content\/uploads\/2025\/09\/the-autonomy-of-tensors-for-smarter-faster-ml-systems-today.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1536\" \/>\n\t<meta property=\"og:image:height\" content=\"1024\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"CPI Staff\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"CPI Staff\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2025\\\/09\\\/18\\\/the-autonomy-of-tensors\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2025\\\/09\\\/18\\\/the-autonomy-of-tensors\\\/\"},\"author\":{\"name\":\"CPI Staff\",\"@id\":\"https:\\\/\\\/cloudproinc.azurewebsites.net\\\/#\\\/schema\\\/person\\\/192eeeb0ce91062126ce3822ae88fe6e\"},\"headline\":\"The Autonomy of Tensors\",\"datePublished\":\"2025-09-18T00:38:02+00:00\",\"dateModified\":\"2025-09-18T00:38:05+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2025\\\/09\\\/18\\\/the-autonomy-of-tensors\\\/\"},\"wordCount\":909,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/cloudproinc.azurewebsites.net\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2025\\\/09\\\/18\\\/the-autonomy-of-tensors\\\/#primaryimage\"},\"thumbnailUrl\":\"\\\/wp-content\\\/uploads\\\/2025\\\/09\\\/the-autonomy-of-tensors-for-smarter-faster-ml-systems-today.png\",\"articleSection\":[\"AI\",\"Blog\",\"LLM\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2025\\\/09\\\/18\\\/the-autonomy-of-tensors\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2025\\\/09\\\/18\\\/the-autonomy-of-tensors\\\/\",\"url\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2025\\\/09\\\/18\\\/the-autonomy-of-tensors\\\/\",\"name\":\"The Autonomy of Tensors - CPI Consulting\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/cloudproinc.azurewebsites.net\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2025\\\/09\\\/18\\\/the-autonomy-of-tensors\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2025\\\/09\\\/18\\\/the-autonomy-of-tensors\\\/#primaryimage\"},\"thumbnailUrl\":\"\\\/wp-content\\\/uploads\\\/2025\\\/09\\\/the-autonomy-of-tensors-for-smarter-faster-ml-systems-today.png\",\"datePublished\":\"2025-09-18T00:38:02+00:00\",\"dateModified\":\"2025-09-18T00:38:05+00:00\",\"description\":\"Explore The Autonomy of Tensors and its significance for engineers and leaders in modern machine learning frameworks.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2025\\\/09\\\/18\\\/the-autonomy-of-tensors\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2025\\\/09\\\/18\\\/the-autonomy-of-tensors\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2025\\\/09\\\/18\\\/the-autonomy-of-tensors\\\/#primaryimage\",\"url\":\"\\\/wp-content\\\/uploads\\\/2025\\\/09\\\/the-autonomy-of-tensors-for-smarter-faster-ml-systems-today.png\",\"contentUrl\":\"\\\/wp-content\\\/uploads\\\/2025\\\/09\\\/the-autonomy-of-tensors-for-smarter-faster-ml-systems-today.png\",\"width\":1536,\"height\":1024},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.cloudproinc.com.au\\\/index.php\\\/2025\\\/09\\\/18\\\/the-autonomy-of-tensors\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/cloudproinc.azurewebsites.net\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Autonomy of Tensors\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/cloudproinc.azurewebsites.net\\\/#website\",\"url\":\"https:\\\/\\\/cloudproinc.azurewebsites.net\\\/\",\"name\":\"Cloud Pro Inc - CPI Consulting Pty Ltd\",\"description\":\"Cloud, AI &amp; Cybersecurity Consulting | Melbourne\",\"publisher\":{\"@id\":\"https:\\\/\\\/cloudproinc.azurewebsites.net\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/cloudproinc.azurewebsites.net\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/cloudproinc.azurewebsites.net\\\/#organization\",\"name\":\"Cloud Pro Inc - Cloud Pro Inc - CPI Consulting Pty Ltd\",\"url\":\"https:\\\/\\\/cloudproinc.azurewebsites.net\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/cloudproinc.azurewebsites.net\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"\\\/wp-content\\\/uploads\\\/2022\\\/01\\\/favfinalfile.png\",\"contentUrl\":\"\\\/wp-content\\\/uploads\\\/2022\\\/01\\\/favfinalfile.png\",\"width\":500,\"height\":500,\"caption\":\"Cloud Pro Inc - Cloud Pro Inc - CPI Consulting Pty Ltd\"},\"image\":{\"@id\":\"https:\\\/\\\/cloudproinc.azurewebsites.net\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/cloudproinc.azurewebsites.net\\\/#\\\/schema\\\/person\\\/192eeeb0ce91062126ce3822ae88fe6e\",\"name\":\"CPI Staff\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2d96eeb53b791d92c8c50dd667e3beec92c93253bb6ff21c02cfa8ca73665c70?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2d96eeb53b791d92c8c50dd667e3beec92c93253bb6ff21c02cfa8ca73665c70?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2d96eeb53b791d92c8c50dd667e3beec92c93253bb6ff21c02cfa8ca73665c70?s=96&d=mm&r=g\",\"caption\":\"CPI Staff\"},\"sameAs\":[\"http:\\\/\\\/www.cloudproinc.com.au\"],\"url\":\"https:\\\/\\\/cloudproinc.azurewebsites.net\\\/index.php\\\/author\\\/cpiadmin\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"The Autonomy of Tensors - CPI Consulting","description":"Explore The Autonomy of Tensors and its significance for engineers and leaders in modern machine learning frameworks.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/","og_locale":"en_US","og_type":"article","og_title":"The Autonomy of Tensors","og_description":"Explore The Autonomy of Tensors and its significance for engineers and leaders in modern machine learning frameworks.","og_url":"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/","og_site_name":"CPI Consulting","article_published_time":"2025-09-18T00:38:02+00:00","article_modified_time":"2025-09-18T00:38:05+00:00","og_image":[{"width":1536,"height":1024,"url":"https:\/\/cloudproinc.azurewebsites.net\/wp-content\/uploads\/2025\/09\/the-autonomy-of-tensors-for-smarter-faster-ml-systems-today.png","type":"image\/png"}],"author":"CPI Staff","twitter_card":"summary_large_image","twitter_misc":{"Written by":"CPI Staff","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/#article","isPartOf":{"@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/"},"author":{"name":"CPI Staff","@id":"https:\/\/cloudproinc.azurewebsites.net\/#\/schema\/person\/192eeeb0ce91062126ce3822ae88fe6e"},"headline":"The Autonomy of Tensors","datePublished":"2025-09-18T00:38:02+00:00","dateModified":"2025-09-18T00:38:05+00:00","mainEntityOfPage":{"@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/"},"wordCount":909,"commentCount":0,"publisher":{"@id":"https:\/\/cloudproinc.azurewebsites.net\/#organization"},"image":{"@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/#primaryimage"},"thumbnailUrl":"\/wp-content\/uploads\/2025\/09\/the-autonomy-of-tensors-for-smarter-faster-ml-systems-today.png","articleSection":["AI","Blog","LLM"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/","url":"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/","name":"The Autonomy of Tensors - CPI Consulting","isPartOf":{"@id":"https:\/\/cloudproinc.azurewebsites.net\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/#primaryimage"},"image":{"@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/#primaryimage"},"thumbnailUrl":"\/wp-content\/uploads\/2025\/09\/the-autonomy-of-tensors-for-smarter-faster-ml-systems-today.png","datePublished":"2025-09-18T00:38:02+00:00","dateModified":"2025-09-18T00:38:05+00:00","description":"Explore The Autonomy of Tensors and its significance for engineers and leaders in modern machine learning frameworks.","breadcrumb":{"@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/#primaryimage","url":"\/wp-content\/uploads\/2025\/09\/the-autonomy-of-tensors-for-smarter-faster-ml-systems-today.png","contentUrl":"\/wp-content\/uploads\/2025\/09\/the-autonomy-of-tensors-for-smarter-faster-ml-systems-today.png","width":1536,"height":1024},{"@type":"BreadcrumbList","@id":"https:\/\/www.cloudproinc.com.au\/index.php\/2025\/09\/18\/the-autonomy-of-tensors\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/cloudproinc.azurewebsites.net\/"},{"@type":"ListItem","position":2,"name":"The Autonomy of Tensors"}]},{"@type":"WebSite","@id":"https:\/\/cloudproinc.azurewebsites.net\/#website","url":"https:\/\/cloudproinc.azurewebsites.net\/","name":"Cloud Pro Inc - CPI Consulting Pty Ltd","description":"Cloud, AI &amp; Cybersecurity Consulting | Melbourne","publisher":{"@id":"https:\/\/cloudproinc.azurewebsites.net\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/cloudproinc.azurewebsites.net\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/cloudproinc.azurewebsites.net\/#organization","name":"Cloud Pro Inc - Cloud Pro Inc - CPI Consulting Pty Ltd","url":"https:\/\/cloudproinc.azurewebsites.net\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/cloudproinc.azurewebsites.net\/#\/schema\/logo\/image\/","url":"\/wp-content\/uploads\/2022\/01\/favfinalfile.png","contentUrl":"\/wp-content\/uploads\/2022\/01\/favfinalfile.png","width":500,"height":500,"caption":"Cloud Pro Inc - Cloud Pro Inc - CPI Consulting Pty Ltd"},"image":{"@id":"https:\/\/cloudproinc.azurewebsites.net\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/cloudproinc.azurewebsites.net\/#\/schema\/person\/192eeeb0ce91062126ce3822ae88fe6e","name":"CPI Staff","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/2d96eeb53b791d92c8c50dd667e3beec92c93253bb6ff21c02cfa8ca73665c70?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/2d96eeb53b791d92c8c50dd667e3beec92c93253bb6ff21c02cfa8ca73665c70?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2d96eeb53b791d92c8c50dd667e3beec92c93253bb6ff21c02cfa8ca73665c70?s=96&d=mm&r=g","caption":"CPI Staff"},"sameAs":["http:\/\/www.cloudproinc.com.au"],"url":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/author\/cpiadmin\/"}]}},"jetpack_featured_media_url":"\/wp-content\/uploads\/2025\/09\/the-autonomy-of-tensors-for-smarter-faster-ml-systems-today.png","jetpack-related-posts":[{"id":53893,"url":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/2025\/09\/18\/get-started-with-tensors-with-pytorch\/","url_meta":{"origin":53890,"position":0},"title":"Get Started With Tensors With PyTorch","author":"CPI Staff","date":"September 18, 2025","format":false,"excerpt":"A clear, hands-on walkthrough of tensors in PyTorch. Learn creation, indexing, math, shapes, and GPU basics with concise examples you can copy-paste.","rel":"","context":"In &quot;AI&quot;","block_context":{"text":"AI","link":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/category\/ai\/"},"img":{"alt_text":"","src":"\/wp-content\/uploads\/2025\/09\/tensors-made-practical-for-engineers-and-data-teams-with-pytorch.png","width":350,"height":200,"srcset":"\/wp-content\/uploads\/2025\/09\/tensors-made-practical-for-engineers-and-data-teams-with-pytorch.png 1x, \/wp-content\/uploads\/2025\/09\/tensors-made-practical-for-engineers-and-data-teams-with-pytorch.png 1.5x, \/wp-content\/uploads\/2025\/09\/tensors-made-practical-for-engineers-and-data-teams-with-pytorch.png 2x, \/wp-content\/uploads\/2025\/09\/tensors-made-practical-for-engineers-and-data-teams-with-pytorch.png 3x, \/wp-content\/uploads\/2025\/09\/tensors-made-practical-for-engineers-and-data-teams-with-pytorch.png 4x"},"classes":[]},{"id":53929,"url":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/2025\/09\/25\/turn-a-list-into-a-tensor-in-python\/","url_meta":{"origin":53890,"position":1},"title":"Turn a List into a Tensor in Python","author":"CPI Staff","date":"September 25, 2025","format":false,"excerpt":"Learn how to convert Python lists into tensors using NumPy, PyTorch, and TensorFlow, with tips on shapes, dtypes, performance, and common pitfalls.","rel":"","context":"In &quot;AI&quot;","block_context":{"text":"AI","link":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/category\/ai\/"},"img":{"alt_text":"","src":"\/wp-content\/uploads\/2025\/09\/turn-a-list-into-a-tensor-in-python-with-numpy-pytorch-tensorflow.png","width":350,"height":200,"srcset":"\/wp-content\/uploads\/2025\/09\/turn-a-list-into-a-tensor-in-python-with-numpy-pytorch-tensorflow.png 1x, \/wp-content\/uploads\/2025\/09\/turn-a-list-into-a-tensor-in-python-with-numpy-pytorch-tensorflow.png 1.5x, \/wp-content\/uploads\/2025\/09\/turn-a-list-into-a-tensor-in-python-with-numpy-pytorch-tensorflow.png 2x, \/wp-content\/uploads\/2025\/09\/turn-a-list-into-a-tensor-in-python-with-numpy-pytorch-tensorflow.png 3x, \/wp-content\/uploads\/2025\/09\/turn-a-list-into-a-tensor-in-python-with-numpy-pytorch-tensorflow.png 4x"},"classes":[]},{"id":53721,"url":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/2025\/08\/27\/what-are-tensors-in-ai-and-large-language-models-llms\/","url_meta":{"origin":53890,"position":2},"title":"What Are Tensors in AI and Large Language Models (LLMs)?","author":"CPI Staff","date":"August 27, 2025","format":false,"excerpt":"In this post \"What Are Tensors in AI and Large Language Models (LLMs)?\", we\u2019ll explore what tensors are, how they are used in AI and LLMs, and why they matter for organizations looking to leverage machine learning effectively. Artificial Intelligence (AI) and Large Language Models (LLMs) like GPT-4 or LLaMA\u2026","rel":"","context":"In &quot;AI&quot;","block_context":{"text":"AI","link":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/category\/ai\/"},"img":{"alt_text":"","src":"\/wp-content\/uploads\/2025\/08\/what-are-tensors-in-ai-and-large-language-models-llms.png","width":350,"height":200,"srcset":"\/wp-content\/uploads\/2025\/08\/what-are-tensors-in-ai-and-large-language-models-llms.png 1x, \/wp-content\/uploads\/2025\/08\/what-are-tensors-in-ai-and-large-language-models-llms.png 1.5x, \/wp-content\/uploads\/2025\/08\/what-are-tensors-in-ai-and-large-language-models-llms.png 2x, \/wp-content\/uploads\/2025\/08\/what-are-tensors-in-ai-and-large-language-models-llms.png 3x, \/wp-content\/uploads\/2025\/08\/what-are-tensors-in-ai-and-large-language-models-llms.png 4x"},"classes":[]},{"id":53932,"url":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/2025\/09\/25\/mastering-common-tensor-operations\/","url_meta":{"origin":53890,"position":3},"title":"Mastering Common Tensor Operations","author":"CPI Staff","date":"September 25, 2025","format":false,"excerpt":"A practical guide to the tensor operations that power modern AI. Learn the essentials, from shapes and broadcasting to vectorization, autograd, and GPU performance.","rel":"","context":"In &quot;AI&quot;","block_context":{"text":"AI","link":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/category\/ai\/"},"img":{"alt_text":"","src":"\/wp-content\/uploads\/2025\/09\/mastering-common-tensor-operations-for-ai-and-data-workloads.png","width":350,"height":200,"srcset":"\/wp-content\/uploads\/2025\/09\/mastering-common-tensor-operations-for-ai-and-data-workloads.png 1x, \/wp-content\/uploads\/2025\/09\/mastering-common-tensor-operations-for-ai-and-data-workloads.png 1.5x, \/wp-content\/uploads\/2025\/09\/mastering-common-tensor-operations-for-ai-and-data-workloads.png 2x, \/wp-content\/uploads\/2025\/09\/mastering-common-tensor-operations-for-ai-and-data-workloads.png 3x, \/wp-content\/uploads\/2025\/09\/mastering-common-tensor-operations-for-ai-and-data-workloads.png 4x"},"classes":[]},{"id":53931,"url":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/2025\/09\/25\/keras-functional-api\/","url_meta":{"origin":53890,"position":4},"title":"Keras Functional API","author":"CPI Staff","date":"September 25, 2025","format":false,"excerpt":"A clear, practical guide to Keras Functional API\u2014why it matters and how to build flexible deep learning models with branching, sharing, and custom workflows.","rel":"","context":"In &quot;AI&quot;","block_context":{"text":"AI","link":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/category\/ai\/"},"img":{"alt_text":"","src":"\/wp-content\/uploads\/2025\/09\/keras-functional-api-demystified-for-flexible-deep-learning-workflows.png","width":350,"height":200,"srcset":"\/wp-content\/uploads\/2025\/09\/keras-functional-api-demystified-for-flexible-deep-learning-workflows.png 1x, \/wp-content\/uploads\/2025\/09\/keras-functional-api-demystified-for-flexible-deep-learning-workflows.png 1.5x, \/wp-content\/uploads\/2025\/09\/keras-functional-api-demystified-for-flexible-deep-learning-workflows.png 2x, \/wp-content\/uploads\/2025\/09\/keras-functional-api-demystified-for-flexible-deep-learning-workflows.png 3x, \/wp-content\/uploads\/2025\/09\/keras-functional-api-demystified-for-flexible-deep-learning-workflows.png 4x"},"classes":[]},{"id":53928,"url":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/2025\/09\/25\/what-are-weights-in-ai-models\/","url_meta":{"origin":53890,"position":5},"title":"What Are Weights in AI Models","author":"CPI Staff","date":"September 25, 2025","format":false,"excerpt":"Understand what model weights are, how they shape predictions, and how to manage, tune, and ship them safely in production.","rel":"","context":"In &quot;AI&quot;","block_context":{"text":"AI","link":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/category\/ai\/"},"img":{"alt_text":"","src":"\/wp-content\/uploads\/2025\/09\/what-are-weights-in-ai-models-and-why-they-matter-for-accuracy.png","width":350,"height":200,"srcset":"\/wp-content\/uploads\/2025\/09\/what-are-weights-in-ai-models-and-why-they-matter-for-accuracy.png 1x, \/wp-content\/uploads\/2025\/09\/what-are-weights-in-ai-models-and-why-they-matter-for-accuracy.png 1.5x, \/wp-content\/uploads\/2025\/09\/what-are-weights-in-ai-models-and-why-they-matter-for-accuracy.png 2x, \/wp-content\/uploads\/2025\/09\/what-are-weights-in-ai-models-and-why-they-matter-for-accuracy.png 3x, \/wp-content\/uploads\/2025\/09\/what-are-weights-in-ai-models-and-why-they-matter-for-accuracy.png 4x"},"classes":[]}],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/posts\/53890","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/comments?post=53890"}],"version-history":[{"count":2,"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/posts\/53890\/revisions"}],"predecessor-version":[{"id":53896,"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/posts\/53890\/revisions\/53896"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/media\/53891"}],"wp:attachment":[{"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/media?parent=53890"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/categories?post=53890"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cloudproinc.azurewebsites.net\/index.php\/wp-json\/wp\/v2\/tags?post=53890"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}