AI & ML Concepts
The vocabulary, decoded: AI, ML, DL, and the terms behind them
You arrive already picturing AI, ML, GenAI, and deep learning as nested sets from the cheat-sheet above; Task Statement 1.1 asks you to define basic AI terms and describe the similarities and differences between AI, ML, GenAI, and deep learning, and here you learn to map any stem's term to its parent. The cheat-sheet above frames these as nested sets; this section pins down the individual vocabulary the blueprint lists by name so a stem can quote any one of them and you still recognize the parent concept. The figure below draws that nesting directly: AI is the outermost set, ML sits inside AI, deep learning inside ML, and generative AI as the innermost set built on deep-learning foundation models.
Neural networks and deep learning, mechanically
A neural network is a model loosely inspired by the human brain[1]: layers of artificial neurons (software nodes) connected by weighted links, with an input layer, one or more hidden layers, and an output layer. Deep learning is simply machine learning that uses neural networks with many hidden layers. AWS describes it as an AI method that "teaches computers to process data in a way that is inspired by the human brain"[2] and explicitly places it as a subset of ML (ML → deep learning → generative AI). The practical reason depth matters: deep networks learn their own hierarchical features from raw, unstructured input, so they handle unstructured data without extensive manual feature engineering[2]. That is why deep learning, not classical ML, powers the two application areas the blueprint names next.
Computer vision and NLP are application domains, not algorithms
Computer vision is the field that extracts information and insights from images and videos[2]: image classification, object detection, facial recognition. Natural language processing (NLP) gathers insights and meaning from text[2]: sentiment, entities, translation, summarization, chatbots. On the exam these are problem domains you map to a service (Amazon Rekognition for vision, Amazon Comprehend for text), not learning techniques. A common trap pairs the domain with the wrong service tier; recognizing "image" vs "text" is the first filter.
Algorithm vs model vs training vs inferencing
The single most tested terminology pair on Task 1.1: an algorithm is the learning procedure; a model is the trained artifact it produces. Training is the phase where the algorithm consumes data and adjusts the model's internal parameters; inferencing (the cheat sheet covers batch vs real-time) is the later phase where the finished model is given new inputs and returns predictions. AWS frames the ML flow exactly this way: historical data is used to train the algorithm[3], and the resulting model then predicts on new, previously unseen data. Hold the two phases apart: you do not "train a model on new data at inference time". Inference is read-only against frozen parameters.
Bias, fairness, and fit are three different ideas the blueprint bundles together
"Bias" is overloaded, and AIF-C01 exploits it. Statistical bias is the underfitting error: a model too simple to capture the signal, defined fully under Fit, bias, and variance below. Societal/data bias and fairness are about outcomes across groups. A model can be accurate on average yet systematically disadvantage a subgroup, which is why responsible-AI controls (Domain 4) exist as a separate layer. Fit is how well the model generalizes from training data to unseen data. When a question says "the model is biased," the surrounding context tells you which meaning: an accuracy/error discussion points to statistical bias, while a demographic or fairness discussion points to data bias.
Learning paradigms and data types under the hood
The cheat-sheet comparison table contrasts supervised, unsupervised, and reinforcement learning at a glance. This section goes one level deeper into why the data dictates the paradigm, and into the data-type taxonomy the blueprint enumerates, because most Domain 1 questions are really a chain: identify the data, infer the paradigm, then name the technique.
Supervised learning: labels are the teacher
In supervised learning, data scientists supply the algorithm with labeled training data[3] (each input is paired with its correct output) and the model learns the mapping. Two sub-shapes matter for the exam: classification predicts a discrete category (spam / not-spam, fraud / legitimate, defect type), and regression predicts a continuous number (price, demand, temperature). If a stem hands you historically labeled examples and asks for a category or a number, it is supervised.
Unsupervised learning: structure without answers
Unsupervised algorithms train on unlabeled data and independently spot patterns and categorize data[3]. The canonical tasks are clustering (group similar records, e.g. customer segmentation), dimensionality reduction, and anomaly detection. The tell in a stem: there is no target column and the goal is discovery ("find natural groups," "surface unusual transactions without prior fraud labels").
Reinforcement learning: reward replaces the dataset
Reinforcement learning has no fixed table of right answers. AWS describes it as attaching reward values to the steps an algorithm must go through[3], with the agent learning a policy that maximizes cumulative reward through trial and error in an environment. Stem signals: an agent, actions, rewards/penalties, sequential decisions, a game or robot/control loop. If you see those words, neither labeled nor merely unlabeled data is the right framing. It is reinforcement learning.
The data taxonomy: four axes, not one
The blueprint lists labeled/unlabeled, tabular, time-series, image, text, and structured/unstructured as data "types," but they live on different axes:
- Labeled vs unlabeled. Does each record carry the target answer? AWS defines labeled data as input categorized with its corresponding defined output value[4]; unlabeled data has no such target. This axis decides supervised vs unsupervised.
- Structured vs unstructured. Structured data fits rows and columns (databases, spreadsheets); unstructured data (free text, images, audio, video) has no fixed schema and typically needs deep learning. AWS notes deep learning's value is handling unstructured input that classical ML struggles with.
- Tabular is structured rows-and-columns; time-series is structured data ordered by timestamp (forecasting); image and text are unstructured.
Note a record can be labeled and tabular and structured simultaneously: the axes are independent, which is why "what type of data is this" questions can have one defensible answer per axis. Read which axis the stem is probing (the answer choices reveal it: if options are supervised/unsupervised, it wants labeled vs unlabeled; if options are services, it wants structured vs unstructured). The figure below lays out both axes side by side: labeled vs unlabeled on one, and structured (tabular, time-series) vs unstructured (image, text) on the other.
Fit, bias, and variance as measurable errors
Overfitting is when a model gives accurate predictions for training data but not for new data[5]: it memorized noise. Underfitting is when the model cannot determine a meaningful relationship between input and output[5] and fails on both training and test data. AWS ties these to the bias-variance tradeoff directly: an underfit model has high bias[5] (inaccurate on both sets), an overfit model has high variance[5] (good on training, poor on test), and more training reduces bias but can increase variance[5], so the goal is the balanced sweet spot. The exam-portable rule: poor on training too → underfit/high bias; great on training but poor on new data → overfit/high variance.
Where these concepts live on AWS: SageMaker AI training and inference
Task 1.1 is conceptual, but AIF-C01 routinely grounds the concepts in the service that owns the full ML build: Amazon SageMaker AI (formerly Amazon SageMaker). Knowing where "training" and the inference flavors live turns abstract terms into answerable mapping questions.
Training happens in a SageMaker AI training job
The "training" phase from Section 1 is realized as a SageMaker AI training job: you point it at data in Amazon S3, choose an algorithm or your own container, and it spins up compute, runs the learning procedure, writes out the model artifact, then tears the compute down. The exam framing is that you train an algorithm to produce a model: the model artifact is what you subsequently deploy. (Hyperparameter tuning, EDA, and feature engineering are out of scope for the practitioner and belong to Task 1.3's lifecycle subtopic, not here.)
Inferencing maps to four SageMaker AI deployment options
The cheat sheet's batch-vs-real-time split expands into the four options SageMaker AI documents, and matching the latency and payload profile to the option is the exam skill:
- Real-time inference. A persistent endpoint for interactive, low-latency[6] requests, one prediction at a time (chatbot reply, fraud check at checkout). Choose it when a human or system is waiting on each prediction.
- Serverless inference. Fully managed, auto-scaling, no infrastructure to size; AWS positions it for workloads with idle periods between traffic spurts that can tolerate cold starts[6]. The cost-conscious choice for intermittent traffic.
- Asynchronous inference. Queues requests for large payloads (up to 1 GB), long processing times (up to one hour), and near-real-time latency[6]. The pick when a single request is too big or slow for a synchronous endpoint but you still want timely results.
- Batch transform. No persistent endpoint at all; AWS recommends it to get inferences from large datasets and run inference when you don't need a persistent endpoint[7]. It reads a dataset from S3, starts compute instances, distributes the workload, and writes predictions back to S3[7], then shuts down. The pick for scheduled bulk scoring (rescore the whole customer base overnight).
The decision rule the exam rewards
Real-time vs batch is the headline distinction the blueprint names, and it hinges on one question: is something waiting on each individual prediction? The figure below models the choice across all four options, following the structure of the AWS "Deploy models for inference" guide. If yes → real-time (or asynchronous for big/slow payloads); if no, and you have a bounded set to score → batch transform; if traffic is spiky and a cold start is acceptable → serverless. Cost and latency move in opposite directions across these (batch is the cheapest per prediction at the cost of latency, real-time is the lowest latency at the cost of always-on compute) and that tradeoff is exactly what a well-written stem makes you weigh.
Exam-pattern recognition: reading AIF-C01 Domain 1 stems
Domain 1 is 20% of the scored exam, and Task 1.1 questions follow a few repeatable shapes. This section names the patterns and shows why the right answer is right and the common distractors are wrong, so you score on recognition rather than recall under time pressure.
Pattern 1: "Which type of learning?" decided by the data, not the goal
The stem describes a dataset and asks for the paradigm. The deciding clue is what the data carries, never the business goal:
- Historical records, each tagged with the outcome → supervised (and if the answer set forces it: a category → classification, a number → regression). Distractor "unsupervised" is wrong precisely because labels are present.
- Records with no target, goal is to find natural groups / outliers → unsupervised (clustering / anomaly detection). Distractor "supervised" is wrong because there is nothing to predict against.
- An agent, rewards, sequential actions → reinforcement learning. Distractors that mention labeled or unlabeled datasets are wrong because RL learns from a reward signal, not a dataset of answers.
Pattern 2: "AI vs ML vs deep learning vs GenAI" the nesting is the answer
The stem offers four overlapping terms and asks which fits, or which is a subset of which. Anchor on the hierarchy: AI ⊃ ML ⊃ deep learning, with generative AI built on deep-learning foundation models. A stem about multi-layer neural networks on images or text points to deep learning; one about learning patterns from data instead of hand-coded rules points to ML; one about producing new content points to GenAI. The classic distractor calls deep learning a replacement for or alternative to ML. It is a subset of ML, so that option is definitionally wrong.
Pattern 3: "Batch or real-time inference?" find who is waiting
The stem gives a deployment scenario and asks for the inference type or the matching service option. Resolve it with the latency question from the previous section: an interactive, one-at-a-time, user-facing prediction → real-time endpoint; a large, bounded dataset scored on a schedule with no waiting user → batch transform. A frequent distractor offers a real-time endpoint for an overnight bulk job, wrong because it pays for always-on compute and adds operational burden the batch use case does not need. The inverse distractor offers batch for a live checkout fraud check, wrong because batch cannot meet interactive latency.
Pattern 4: "The model performs well in training but poorly in production" overfitting
This is the single most recognizable fit question. "Great on training data, poor on new/unseen data" is the textbook signature of overfitting / high variance; "poor on both training and new data" is underfitting / high bias. The distractor swaps the two, or blames "insufficient training" for an overfit model (more training of the same kind can worsen overfitting). Map the symptom to the term mechanically and the distractors collapse.
Pattern 5: "Should we even use ML here?" appropriateness
Some stems describe a problem and ask whether AI/ML is the right tool. The exam-correct instinct: ML fits when rules are too complex to hand-code but representative data exists; it is the wrong tool when a single guaranteed, deterministic, or fully auditable answer is required (tax calculation, an access-control rule), or when there is too little representative data. A distractor that reaches for a custom ML model where a deterministic rule or a higher-level managed AI service already solves the problem is wrong on cost-benefit grounds: a recurring AWS theme is choosing the highest-level service that solves the problem rather than building from scratch.
The three ML learning paradigms at a glance
| Aspect | Supervised learning | Unsupervised learning | Reinforcement learning |
|---|---|---|---|
| Input data | Labeled (input paired with correct output) | Unlabeled (no target provided) | No fixed dataset; agent interacts with an environment |
| Learning signal | Known correct answers | Structure inherent in the data | Rewards and penalties for actions taken |
| Goal | Predict a label or value for new inputs | Discover groupings or structure | Learn a policy that maximizes cumulative reward |
| Typical tasks | Classification, regression | Clustering, dimensionality reduction, anomaly detection | Sequential decision-making and control |
| Example | Predict whether an email is spam | Segment customers into similar groups | Train a system to play a game or route a robot |
Decision tree
Sharp facts the exam loves — give these one last read before exam day.
Cheat sheet
Sharp facts the exam loves — scan these before test day.
- AI ⊃ ML ⊃ deep learning ⊃ generative AI are nested subsets
These four terms nest, they are not synonyms: AI is the broad goal of machine intelligence, ML is the subset that learns patterns from data instead of hand-coded rules, deep learning is the subset of ML built on multi-layer neural networks, and generative AI is the application built on deep-learning foundation models. Because each is contained in the one above, deep learning is a form of ML, never a competing alternative to it.
Trap Treating deep learning as a replacement for or alternative to machine learning, when it is a subset of it.
Deep learning is machine learning that uses neural networks stacked with many hidden layers between the input and output layers of weighted artificial neurons. That depth lets the network learn its own hierarchical features straight from raw, unstructured input, which is why it powers computer vision and NLP without the manual feature engineering classical ML demands.
Trap Calling any single-layer neural network deep learning, when the 'deep' refers to the many stacked hidden layers it adds.
- Computer vision and NLP are problem domains, not algorithms
Computer vision and NLP are application domains you map a need onto, not learning techniques. Computer vision extracts insight from images and video (classification, object detection, facial recognition); NLP extracts meaning from text (sentiment, entities, translation, summarization). The exam offers them as the answer to "what kind of problem is this," so don't read them as paradigms or model types.
Trap Picking a learning paradigm (supervised, unsupervised) when the stem is actually asking which problem domain (vision vs language) applies.
- The algorithm is the procedure; the model is the trained artifact
An algorithm is the learning procedure (gradient descent, a decision-tree splitting rule); a model is the artifact that procedure produces, storing the learned parameters you then deploy. The exam-portable phrasing is: you train an algorithm on data to produce a model, then run inference with the model. Keep the two roles distinct, because a stem often swaps them to test exactly this.
Trap Calling the algorithm the deployed thing that makes predictions: predictions come from the trained model, not the procedure that built it.
- Training writes the parameters; inference only reads them
Training is the phase where the algorithm consumes data and adjusts the model's internal parameters; inference is the later phase where the finished model takes new, unseen input and returns a prediction. No learning happens at inference time: it runs read-only against frozen parameters, which is why serving cost and retraining cost are separate concerns.
Trap Assuming a model keeps learning from the live requests it serves: parameters are fixed at inference until you deliberately retrain.
- Supervised learning needs labeled data with known outputs
Supervised learning trains on labeled examples (each input paired with its correct output) to learn the mapping from one to the other. It splits into two shapes: classification predicts a discrete category (spam vs not-spam, fraud vs legitimate), and regression predicts a continuous number (price, demand). A stem that hands you historical records already tagged with the answer and asks for a category or a number is supervised.
Trap Reaching for unsupervised learning when the data already carries the labeled outcome you want to predict: labeled targets make it supervised.
11 questions test this
- A recently opened manufacturing plant wants to predict equipment failures by using Amazon SageMaker AI. The plant has logged only a handful…
- An online payments company wants to use Amazon Fraud Detector to label each incoming transaction as either fraudulent or legitimate, based…
- A financial services company plans to use Amazon SageMaker AI to train a model that flags new credit card transactions as fraudulent or…
- A retail company uses Amazon SageMaker AI to build a model that predicts the specific dollar amount of revenue each store will generate…
- A data scientist is reviewing several business problems to determine which one is BEST solved by using a regression model. Which problem…
- An ecommerce company already uses Amazon Personalize to recommend products. The data science team now wants to predict the exact future…
- A company uses Amazon SageMaker AI and wants to predict the exact number of products it will sell next month based on historical sales data…
- A company wants to use Amazon SageMaker AI to automatically route each incoming customer support ticket to one of five predefined…
- A subscription streaming company wants to predict whether each customer will cancel the subscription next month. The company has a labeled…
- A data scientist is choosing a learning approach for a new project that will use Amazon SageMaker AI. Which statement correctly describes…
- A logistics company uses Amazon SageMaker AI to build a model that predicts the number of days each shipment will take to reach its…
- Unsupervised learning finds structure in unlabeled data
Unsupervised learning trains on unlabeled data with no target column and surfaces patterns on its own. Its canonical tasks are clustering (customer segmentation), dimensionality reduction, and anomaly detection. The tell in a stem is the absence of a known answer paired with a discovery goal: "find natural groups," "flag unusual transactions without any prior fraud labels."
Trap Labeling anomaly detection on unlabeled data as supervised: there are no fraud labels to learn from, so the model groups by structure alone.
3 questions test this
- A media company has a large collection of unlabeled news articles. The company wants to use Amazon SageMaker AI to discover natural…
- A retail company wants to use Amazon SageMaker AI to divide its customers into groups based on purchasing behavior. The company does not…
- A marketing team has a large dataset of customer purchase behavior with no predefined labels or groups. The team wants to discover natural…
- Reinforcement learning replaces the dataset with a reward signal
Reinforcement learning has no fixed table of right answers: an agent takes actions in an environment and learns a policy that maximizes cumulative reward by trial and error. Stem signals are an agent, actions, rewards or penalties, sequential decisions, or a game/robot/control loop. The learning comes from the reward feedback, not from a corpus of labeled or unlabeled examples.
Trap Choosing an answer that frames reinforcement learning as training on a labeled or unlabeled dataset: RL learns from rewards, not a dataset of answers.
- The learning paradigm is decided by the data, not the goal
To choose supervised vs unsupervised vs reinforcement, read what the data carries, never the business objective: each record tagged with its outcome → supervised; no target, asking to find groups or outliers → unsupervised; an agent earning rewards through a feedback loop → reinforcement. The same business goal can land in different paradigms depending only on the data you hold.
Trap Picking the learning paradigm from the business objective, when only the data you hold (labeled, unlabeled, or reward-driven) decides it.
3 questions test this
- A retail company wants to use Amazon SageMaker AI to divide its customers into groups based on purchasing behavior. The company does not…
- A financial services company plans to use Amazon SageMaker AI to train a model that flags new credit card transactions as fraudulent or…
- A data scientist is choosing a learning approach for a new project that will use Amazon SageMaker AI. Which statement correctly describes…
- Data attributes live on independent axes
Labeled vs unlabeled, structured vs unstructured, and the concrete shape (tabular, time-series, image, text) are separate axes: one record can be labeled and tabular and structured all at once. Only the labeled-vs-unlabeled axis decides supervised vs unsupervised; the answer choices reveal which axis a "what type of data" stem is really probing.
Trap Assuming structured data must be labeled or that unstructured data must be unlabeled, when those axes are independent of each other.
- Structured data fits rows and columns; unstructured needs deep learning
Structured data has a standardized tabular format: rows and columns with a defined schema, as in databases and spreadsheets (including timestamp-ordered time-series). Unstructured data (free text, images, audio, video) has no set data model, makes up roughly 80–90% of enterprise data, and typically calls for deep learning, since classical tabular methods can't capture its signal.
Trap Reaching for classical tabular methods on free text, images, or audio, when unstructured data has no schema and typically needs deep learning.
- Real-time vs batch inference: is something waiting on each prediction?
Real-time (online) inference serves one prediction at a time from a persistent low-latency endpoint for interactive use (a chatbot reply, a fraud check at checkout). Batch inference scores a large, bounded set asynchronously on a schedule, trading latency for throughput and a lower cost per prediction (rescore the whole customer base overnight). The deciding question is whether a human or system is waiting on each individual prediction.
Trap Choosing batch versus real-time by dataset size rather than by whether something is waiting on each individual prediction.
4 questions test this
- A company has millions of archived customer support emails stored in Amazon S3. The company wants to use Amazon Comprehend to analyze the…
- A retailer wants to use Amazon Rekognition to detect when a person enters a restricted area in a live security camera video feed and to…
- A company has a trained model and a large dataset stored in Amazon S3. The company wants to generate predictions for the entire dataset at…
- A bank uses Amazon Comprehend to analyze incoming customer chat messages and must return sentiment results instantly so that agents can…
- Inference cost and latency pull in opposite directions
Across deployment patterns the tradeoff is fixed: batch inference is cheapest per prediction but highest latency, while a real-time endpoint is lowest latency but pays for always-on compute. Match the pattern to whether anything waits on the result: an overnight bulk job wants batch, a live checkout fraud check needs the real-time endpoint.
Trap Putting an overnight bulk-scoring job on an always-on real-time endpoint: it meets a latency requirement nobody has while paying for idle compute.
4 questions test this
- A company has millions of archived customer support emails stored in Amazon S3. The company wants to use Amazon Comprehend to analyze the…
- A retailer wants to use Amazon Rekognition to detect when a person enters a restricted area in a live security camera video feed and to…
- A company has a trained model and a large dataset stored in Amazon S3. The company wants to generate predictions for the entire dataset at…
- A bank uses Amazon Comprehend to analyze incoming customer chat messages and must return sentiment results instantly so that agents can…
- Overfitting: accurate on training data, poor on new data
A model overfits when it memorizes the noise and quirks of its training data, scoring well on that data but poorly on new, unseen data. The exam signature is "performs well in training but poorly on new data." Crucially, more training of the same kind can increase variance and worsen overfitting, so "insufficient training" is a wrong diagnosis for an overfit model.
Trap Blaming insufficient training for an overfit model: more of the same training tightens the fit to noise and makes overfitting worse, not better.
3 questions test this
- A data science team at a retail company is using Amazon SageMaker to train a machine learning model for customer churn prediction. After…
- A machine learning team is using Amazon SageMaker to train a fraud detection model. During training, the team observes that the model…
- A data scientist is using Amazon SageMaker to train a classification model. After evaluating the model, the data scientist observes that…
- Underfitting: poor on both training and new data
A model underfits when it is too simple to capture the real signal, so it never finds a meaningful input-output relationship and scores poorly on both training and new data. The mechanical rule that separates the two failure modes: poor on training too → underfit; great on training but poor on new data → overfit.
Trap Diagnosing a model that scores poorly on its own training data as overfit, when poor training performance is the signature of underfitting.
- Bias-variance: underfit is high bias, overfit is high variance
The bias-variance tradeoff maps straight onto fit: an underfit model has high bias (inaccurate on both training and test sets), while an overfit model has high variance (accurate on training but not on test/unseen data). The target is the balanced sweet spot that generalizes, which is exactly why a model's quality is judged on held-out data rather than the data it trained on.
Trap Pairing overfitting with high bias and underfitting with high variance, when it is the reverse: overfit is high variance, underfit is high bias.
3 questions test this
- A data science team at a retail company is using Amazon SageMaker to train a machine learning model for customer churn prediction. After…
- A machine learning team is using Amazon SageMaker to train a fraud detection model. During training, the team observes that the model…
- A data scientist is using Amazon SageMaker to train a classification model. After evaluating the model, the data scientist observes that…
- "Bias" carries two distinct meanings on AIF-C01
On this exam "bias" means two unrelated things. Statistical bias is the underfitting error of a too-simple model. Societal/data bias is about outcomes across groups: a model can be accurate on average yet systematically disadvantage a subgroup because the training data encodes historical inequities. An accuracy-and-error stem points at statistical bias; a demographic-and-fairness stem points at data bias.
Trap Reading every mention of "bias" as the statistical underfitting error, when a fairness stem is about disparate outcomes across demographic groups.
- High overall accuracy does not guarantee fairness
Fairness is a model treating relevant groups equitably, and it is independent of average accuracy: a model can be accurate overall yet unfair to a subgroup. AWS even lists fairness as its own dimension of responsible AI, separate from accuracy/robustness, which is why an accurate-but-biased model can still be the wrong one to deploy and why responsible-AI controls exist as a distinct layer.
Trap Concluding a model is safe to deploy because its overall accuracy is high: fairness across groups is a separate property accuracy can't vouch for.
- Embedding models turn text and images into semantic vectors
An embedding model converts text (and, for multimodal embeddings, images too) into numerical vectors that capture semantic meaning, placing similar items close together in vector space. This is the component behind semantic search and Amazon Bedrock Knowledge Bases; a multimodal embedding model puts text and image queries into one shared space so a single model can answer both.
Trap Confusing an embedding model with a generative LLM, when an embedding model outputs numerical vectors for similarity search rather than generated text.
7 questions test this
- A company wants to use Amazon Bedrock to build a semantic search application that retrieves relevant information from internal documents.…
- A retail company wants to build a product search application that can match customer product images with similar items in their catalog.…
- A machine learning practitioner is building a semantic search application using Amazon Bedrock. The application needs to convert product…
- A company wants to use Amazon Bedrock for multiple generative AI use cases including semantic search, content summarization, and image…
- A company wants to implement a semantic search solution using Amazon Bedrock to find similar documents in their knowledge base. The company…
- A company wants to implement a semantic search application using Amazon Bedrock Knowledge Bases. The application must convert product…
- A company is building a product search application using Amazon Bedrock. The application must allow customers to search for products using…
- Temperature trades determinism for randomness
Temperature is an inference parameter that reshapes the next-token probability distribution: a low value near 0 steepens it toward more deterministic, consistent answers (FAQ and support bots), while a high value flattens it toward more random, varied output. Lower the temperature when you need repeatable, factual responses; raise it when you want more diverse, creative generation.
Trap Raising temperature to make a model more accurate: it only increases randomness; for consistent, factual answers you lower it instead.
4 questions test this
- A developer is using Amazon Bedrock to build a customer service chatbot. The chatbot occasionally provides different answers to the same…
- A company is using Amazon Bedrock to build a customer support chatbot. The development team wants to reduce the randomness in the…
- A machine learning team is building a creative writing application using Amazon Bedrock. The team wants the foundation model to generate…
- A machine learning engineer is configuring an Amazon Bedrock foundation model to generate creative marketing content. The engineer wants to…