We believe that a hidden chain of thought presents a unique opportunity for monitoring models. Assuming it is faithful and legible, the hidden chain of thought allows us to "read the mind" of the model and understand its thought process. For example, in the future we may wish to monitor the chain of thought for signs of manipulating the user. However, for this to work the model must have freedom to express its thoughts in unaltered form, so we cannot train any policy compliance or user preferences onto the chain of thought. We also do not want to make an unaligned chain of thought directly visible to users.
Therefore, after weighing multiple factors including user experience, competitive advantage, and the option to pursue the chain of thought monitoring, we have decided not to show the raw chains of thought to users. We acknowledge this decision has disadvantages. We strive to partially make up for it by teaching the model to reproduce any useful ideas from the chain of thought in the answer. For the o1 model series we show a model-generated summary of the chain of thought.
o1 significantly advances the state-of-the-art in AI reasoning. We plan to release improved versions of this model as we continue iterating. We expect these new reasoning capabilities will improve our ability to align models to human values and principles. We believe o1 – and its successors – will unlock many new use cases for AI in science, coding, math, and related fields. We are excited for users and API developers to discover how it can improve their daily work.
Dataset | Metric | gpt-4o | o1-preview | o1 |
---|---|---|---|---|
Competition Math AIME (2024) | cons@64 | 13.4 | 56.7 | 83.3 |
pass@1 | 9.3 | 44.6 | 74.4 | |
Competition Code CodeForces | Elo | 808 | 1,258 | 1,673 |
Percentile | 11.0 | 62.0 | 89.0 | |
GPQA Diamond | cons@64 | 56.1 | 78.3 | 78.0 |
pass@1 | 50.6 | 73.3 | 77.3 | |
Biology | cons@64 | 63.2 | 73.7 | 68.4 |
pass@1 | 61.6 | 65.9 | 69.2 | |
Chemistry | cons@64 | 43.0 | 60.2 | 65.6 |
pass@1 | 40.2 | 59.9 | 64.7 | |
Physics | cons@64 | 68.6 | 89.5 | 94.2 |
pass@1 | 59.5 | 89.4 | 92.8 | |
MATH | pass@1 | 60.3 | 85.5 | 94.8 |
MMLU | pass@1 | 88.0 | 92.3 | 90.8 |
MMMU (val) | pass@1 | 69.1 | n/a | 78.2 | pass@1 | 63.8 | n/a | 73.9 |
https://www.anthropic.com/news/claude-3-5-sonnet (opens in a new window) , https://deepmind.google/technologies/gemini/pro (opens in a new window)
Our evaluations used the same 500 problem test split found in https://arxiv.org/abs/2305.20050 (opens in a new window)
https://codeforces.com/blog/entry/68288 (opens in a new window)
Run a free plagiarism check in 10 minutes, generate accurate citations for free.
Methodology
Published on January 2, 2023 by Shona McCombes . Revised on September 11, 2023.
What is a literature review? A literature review is a survey of scholarly sources on a specific topic. It provides an overview of current knowledge, allowing you to identify relevant theories, methods, and gaps in the existing research that you can later apply to your paper, thesis, or dissertation topic .
There are five key steps to writing a literature review:
A good literature review doesn’t just summarize sources—it analyzes, synthesizes , and critically evaluates to give a clear picture of the state of knowledge on the subject.
Upload your document to correct all your mistakes in minutes
What is the purpose of a literature review, examples of literature reviews, step 1 – search for relevant literature, step 2 – evaluate and select sources, step 3 – identify themes, debates, and gaps, step 4 – outline your literature review’s structure, step 5 – write your literature review, free lecture slides, other interesting articles, frequently asked questions, introduction.
When you write a thesis , dissertation , or research paper , you will likely have to conduct a literature review to situate your research within existing knowledge. The literature review gives you a chance to:
Writing literature reviews is a particularly important skill if you want to apply for graduate school or pursue a career in research. We’ve written a step-by-step guide that you can follow below.
The academic proofreading tool has been trained on 1000s of academic texts. Making it the most accurate and reliable proofreading tool for students. Free citation check included.
Try for free
Writing literature reviews can be quite challenging! A good starting point could be to look at some examples, depending on what kind of literature review you’d like to write.
You can also check out our templates with literature review examples and sample outlines at the links below.
Download Word doc Download Google doc
Before you begin searching for literature, you need a clearly defined topic .
If you are writing the literature review section of a dissertation or research paper, you will search for literature related to your research problem and questions .
Start by creating a list of keywords related to your research question. Include each of the key concepts or variables you’re interested in, and list any synonyms and related terms. You can add to this list as you discover new keywords in the process of your literature search.
Use your keywords to begin searching for sources. Some useful databases to search for journals and articles include:
You can also use boolean operators to help narrow down your search.
Make sure to read the abstract to find out whether an article is relevant to your question. When you find a useful book or article, you can check the bibliography to find other relevant sources.
You likely won’t be able to read absolutely everything that has been written on your topic, so it will be necessary to evaluate which sources are most relevant to your research question.
For each publication, ask yourself:
Make sure the sources you use are credible , and make sure you read any landmark studies and major theories in your field of research.
You can use our template to summarize and evaluate sources you’re thinking about using. Click on either button below to download.
As you read, you should also begin the writing process. Take notes that you can later incorporate into the text of your literature review.
It is important to keep track of your sources with citations to avoid plagiarism . It can be helpful to make an annotated bibliography , where you compile full citation information and write a paragraph of summary and analysis for each source. This helps you remember what you read and saves time later in the process.
Discover proofreading & editing
To begin organizing your literature review’s argument and structure, be sure you understand the connections and relationships between the sources you’ve read. Based on your reading and notes, you can look for:
This step will help you work out the structure of your literature review and (if applicable) show how your own research will contribute to existing knowledge.
There are various approaches to organizing the body of a literature review. Depending on the length of your literature review, you can combine several of these strategies (for example, your overall structure might be thematic, but each theme is discussed chronologically).
The simplest approach is to trace the development of the topic over time. However, if you choose this strategy, be careful to avoid simply listing and summarizing sources in order.
Try to analyze patterns, turning points and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred.
If you have found some recurring central themes, you can organize your literature review into subsections that address different aspects of the topic.
For example, if you are reviewing literature about inequalities in migrant health outcomes, key themes might include healthcare policy, language barriers, cultural attitudes, legal status, and economic access.
If you draw your sources from different disciplines or fields that use a variety of research methods , you might want to compare the results and conclusions that emerge from different approaches. For example:
A literature review is often the foundation for a theoretical framework . You can use it to discuss various theories, models, and definitions of key concepts.
You might argue for the relevance of a specific theoretical approach, or combine various theoretical concepts to create a framework for your research.
Like any other academic text , your literature review should have an introduction , a main body, and a conclusion . What you include in each depends on the objective of your literature review.
The introduction should clearly establish the focus and purpose of the literature review.
Depending on the length of your literature review, you might want to divide the body into subsections. You can use a subheading for each theme, time period, or methodological approach.
As you write, you can follow these tips:
In the conclusion, you should summarize the key findings you have taken from the literature and emphasize their significance.
When you’ve finished writing and revising your literature review, don’t forget to proofread thoroughly before submitting. Not a language expert? Check out Scribbr’s professional proofreading services !
This article has been adapted into lecture slides that you can use to teach your students about writing a literature review.
Scribbr slides are free to use, customize, and distribute for educational purposes.
Open Google Slides Download PowerPoint
If you want to know more about the research process , methodology , research bias , or statistics , make sure to check out some of our other articles with explanations and examples.
Statistics
Research bias
A literature review is a survey of scholarly sources (such as books, journal articles, and theses) related to a specific topic or research question .
It is often written as part of a thesis, dissertation , or research paper , in order to situate your work in relation to existing knowledge.
There are several reasons to conduct a literature review at the beginning of a research project:
Writing the literature review shows your reader how your work relates to existing research and what new insights it will contribute.
The literature review usually comes near the beginning of your thesis or dissertation . After the introduction , it grounds your research in a scholarly field and leads directly to your theoretical framework or methodology .
A literature review is a survey of credible sources on a topic, often used in dissertations , theses, and research papers . Literature reviews give an overview of knowledge on a subject, helping you identify relevant theories and methods, as well as gaps in existing research. Literature reviews are set up similarly to other academic texts , with an introduction , a main body, and a conclusion .
An annotated bibliography is a list of source references that has a short description (called an annotation ) for each of the sources. It is often assigned as part of the research process for a paper .
If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.
McCombes, S. (2023, September 11). How to Write a Literature Review | Guide, Examples, & Templates. Scribbr. Retrieved September 27, 2024, from https://www.scribbr.com/dissertation/literature-review/
Other students also liked, what is a theoretical framework | guide to organizing, what is a research methodology | steps & tips, how to write a research proposal | examples & templates, get unlimited documents corrected.
✔ Free APA citation check included ✔ Unlimited document corrections ✔ Specialized in correcting academic texts
COMMENTS
Learn how to introduce your topic, provide background, establish your problem, and specify your objective in a research paper introduction. See examples for argumentative and empirical papers.
The introduction of a research paper provides an overview of the study's purpose, scope, and significance. Read this article to understand what is a research paper introduction, its importance and how to write a research paper introduction with examples.
Learn how to write a research paper with this comprehensive guide that covers the definition, structure, methods, and examples of a research paper. Follow the steps to choose a topic, conduct a literature review, develop a thesis, plan your research, collect and analyze data, organize your paper, and cite your sources.
How to Write a Research Paper | A Beginner's Guide A research paper is a piece of academic writing that provides analysis, interpretation, and argument based on in-depth independent research. Research papers are similar to academic essays, but they are usually longer and more detailed assignments, designed to assess not only your writing skills but also your skills in scholarly research ...
Here's an introductory paragraph for a paper I wrote. I started the paper with a factoid, then presented each main point of my paper and then ended with my thesis statement.
All research papers have pretty much the same structure. If you can write one type of research paper, you can write another. Learn the steps to start and complete your research paper in our guide.
Learn how to write a research paper in three easy steps: finding a topic and reviewing the literature, developing a structure and outline, and writing up your draft. See examples, templates, and tips for each section of your paper.
Explore the nuances of writing a standout research paper introduction. From the initial hook to the thesis statement, this guide is your go-to resource for starting your academic paper correctly.
How to Write an Essay Introduction | 4 Steps & Examples Published on February 4, 2019 by Shona McCombes. Revised on July 23, 2023. A good introduction paragraph is an essential part of any academic essay. It sets up your argument and tells the reader what to expect. The main goals of an introduction are to: Catch your reader's attention. Give background on your topic. Present your thesis ...
Writing a Research Paper Introduction (with 3 Examples) Nail your research paper's introduction! Learn to captivate and inform readers from the start—our guide shows how!
Research paper introduction is the first section of a research paper that provides an overview of the study, its purpose, and the research question (s) or hypothesis (es) being investigated. It typically includes background information about the topic, a review of previous research in the field, and a statement of the research objectives.
In this guide we concisely explain how to write an academic research paper step by step. We'll cover areas like how to start a research paper, how to write a research paper outline, how to use citations and evidence, and how to write a conclusion for a research paper. But before we get into the details, let's take a look at what a research ...
Need help writing a research paper? Our step-by-step guide offers tips and tricks for crafting a fantastic document and ensuring it stands out.
Read our guide to master how to start a research paper and format a title page. The described stages will lead you through the writing process smoothly.
Looking for research paper introduction examples? Quotes, anecdotes, questions, examples, and broad statements—all of them can be used successfully to write an introduction for a research paper. It's instructive to see them in action, in the hands of skilled academic writers.
Thinking how to start a research paper? Check out our easy-to-follow, step-by-step guide on starting a research paper with practical tips and examples!
The introduction to a research paper can be the most challenging part of the paper to write. The length of the introduction will vary depending on the type of research paper you are writing. An introduction should announce your topic, provide context and a rationale for your work, before stating your research questions and hypothesis. Well-written introductions set the tone for the paper ...
First, you need to know the central idea that will organize this paragraph. If you have already made a plan or outline of your paper's overall structure, you should already have a good idea of what each paragraph will aim to do. You can start by drafting a sentence that sums up your main point and introduces the paragraph's focus.
Wondering how to start a research paper? Our handy guide will help you start your research paper by providing all the detailed elements. Read now!
That said, writing conventions vary widely across countries, cultures, and even disciplines. For example, although the hourglass model introduces the most important point right from the beginning as a guide to the rest of the paper, some traditions build the argument gradually and deliver the main idea as a punchline.
Key steps to write a research paper 1. Develop a strong thesis statement. Create a specific, focused thesis: Your thesis statement should be specific, covering only what will be discussed in the paper and supported with specific evidence; Place the thesis strategically: The thesis statement usually appears at the end of the first paragraph of a paper ; Be prepared to revise: The topic may ...
Show how your work fits with existing research; Describe the purpose of your paper or proposal; The following sections of this guide will explain each part of the CARS model, accompanied by examples to help you apply it to your writing. This model has proven valuable for many researchers and students, helping them produce clear, strong ...
Learn how to turn a weak research question into a strong one with examples suitable for a research paper, thesis or dissertation.
By the time your essay is done, you should have provided your reader with a new perspective or challenged existing findings. This demonstrates your mastery of the subject and contributes to ongoing scholarly debates. 7 Tips for Writing a Research Paper. Often, getting started is the most challenging part of a research paper.
A synthesis essay combines information from different sources to support a central argument or analysis. It's not about summarizing sources but about connecting them to form a unified point of view. Start with a compelling hook to grab attention, introduce your topic clearly, and end with a solid thesis statement that outlines your main argument.
Learn how to choose a topic, identify a problem, formulate research questions, create a research design, and write a research proposal for your thesis or dissertation. See examples, tips, and resources for each step of the research process.
Let's break this down step by step based on the example: 1. Example given: • Input: oyfjdnisdr rtqwainr acxz mynzbhhx • Output: Think step by step By examining the words: • The pattern involves selecting specific letters or transforming them. 2. Now, let's decode the new phrase: • Input: oyekaijzdf aaptcg suaokybhai ouow aqht mynznvaatzacdfoulxxz
What is the purpose of a literature review? When you write a thesis, dissertation, or research paper, you will likely have to conduct a literature review to situate your research within existing knowledge. The literature review gives you a chance to: Demonstrate your familiarity with the topic and its scholarly context Develop a theoretical framework and methodology for your research Position ...