Benjamin Keep, PhD, JD
Benjamin Keep, PhD, JD
  • 85
  • 3 268 178
The Essentials of Problem Solving
An introduction to the psychology of problem solving. Featured problems: the towers of Hanoi, the Chinese ring puzzle, the Wason 4-card selection task, the candle problem, Roman matchstick problems, and toothpick shape problems.
00:00 A quick note
00:47 The problem state space and the towers of Hanoi
4:45 Problems of representation and the Chinese ring puzzle
6:42 Context and variations of the Wason 4-card selection task
9:42 Introduction to insight problems: the candle problem
11:05 Differences between insight and incremental problems
12:15 Barriers to insight: Roman matchstick problems
17:30 Insight problems: too big of a distinction?
19:08 Well-structured and ill-structured problems
21:11 Representation and argument
23:34 Becoming a better problem solver: toothpick problems
26:45 Domain-specific knowledge and strategy change
30:55 What transfers across problem-solving domains?
Sign up to my newsletter here: www.benjaminkeep.com.
ACKNOWLEDGEMENTS
The towers of Hanoi footage comes from Math Playground's version of the towers.
The Chinese ring puzzle footage comes from UA-camr @Jojikiba, here ua-cam.com/video/nydIl2VO12I/v-deo.html
The candle problem visuals: ua-cam.com/video/PEvThYxtnFQ/v-deo.html. If you made it or you know who did, please let me know. The link above seems to be the oldest and most complete version.
Paul Zeitz photo: www.imo-official.org/advisory.aspx?year=2019
Math and STEP problems: www.imo-official.org/problems/IMO2022SL.pdf and www.usmle.org/sites/default/files/2021-10/Step_1_Sample_Items.pdf, respectively.
Physics problems: Badeau, R., White, D. R., Ibrahim, B., Ding, L., & Heckler, A. F. (2017). What works with worked examples: Extending self-explanation and analogical comparison to synthesis problems. Physical Review Physics Education Research, 13(2), 020112. doi.org/10.1103/PhysRevPhysEducRes.13.020112
Visit www.eternagame.org for more info on Eterna.
The Chess explanation clip: @BetterChessTraining.
The Starcraft 2 clip: an @ESChamp video, here: ua-cam.com/video/4okBbHaCQ98/v-deo.html
The go examples come from Sensei’s library: senseis.xmp.net/?CornersThenSidesThenCenter
Starcraft 2 map: news.blizzard.com/en-us/starcraft2/23223597/new-ladder-maps-for-2019-season-4
Parity example: artofproblemsolving.com/wiki/index.php?title=Parity
The free body diagram is from a Math and Science video: ua-cam.com/video/mI11vHsRnC8/v-deo.html
The map of Easter Island: en.wikipedia.org/wiki/File:Easter_Island_map-en.svg
The cashflow statement: en.wikipedia.org/wiki/Cash_flow_statement#cite_note-21, but is originally from Epstein, Barry J.; Eva K. Jermakowicz (2007). Interpretation and Application of International Financial Reporting Standards. John Wiley & Sons. pp. 91-97. ISBN 978-0-471-79823-1.
REFERENCES
Simon, H. A., & Newell, A. (1971). Human problem solving: The state of the theory in 1970. American psychologist, 26(2), 145.
The tower of Hanoi state space was adapted from Zhang, J., & Norman, D. A. (1994). Representations in distributed cognitive tasks. Cognitive science, 18(1), 87-122.
The Chinese Ring puzzle state space (for 5 rings) is adapted from Kotovsky, K. & Simon, H. A. (1990). What Makes Some Problems Really hard: Explorations in the Problem Space of Difficulty. Cognitive Psychology, 22(2), 143-183.
The “underage drinking” example of the Wason 4-card task comes from this classic:
Griggs, R. A., & Cox, J. R. (1982). The elusive thematic‐materials effect in Wason's selection task. British journal of psychology, 73(3), 407-420.
A short meta-analysis on the Wason 4-card task: Ragni, M., Kola, I., & Johnson-Laird, P. (2017). The Wason Selection task: A Meta-Analysis. In CogSci. www.researchgate.net/profile/Ilir-Kola/publication/322682384_The_Wason_Selection_Task_A_Meta-Analysis/links/5a688e6f4585156abdffd541/The-Wason-Selection-Task-A-Meta-Analysis.pdf
On the insight experience: Webb, M. E., Little, D. R., & Cropper, S. J. (2016). Insight Is Not in the Problem: Investigating Insight in Problem Solving across Task Types. Frontiers in Psychology, 7. www.frontiersin.org/articles/10.3389/fpsyg.2016.01424
The Matchstick Roman numeral problems and the discussion of constraints and chunks come from: Öllinger, M., Jones, G., & Knoblich, G. (2008). Investigating the Effect of Mental Set on Insight Problem Solving. Experimental Psychology, 55(4), 269-282. doi.org/10.1027/1618-3169.55.4.269
On strategic change, see: Siegler, R. S. (2002). Microgenetic studies of self-explanation. Microdevelopment: Transition processes in development and learning, 31, 58.
On the importance of representations in ill-structured domains, see: Chandrasekharan, S., & Nersessian, N. J. (2011). Building cognition: the construction of external representations for discovery. In Proceedings of the Annual Meeting of the Cognitive Science Society (Vol. 33, No. 33).
Переглядів: 134 385

Відео

Learning Foreign Language Vocabulary - The Fundamentals
Переглядів 14 тис.5 місяців тому
Some thoughts on learning foreign language vocabulary. The “Chinese is Hard” podcast: open.spotify.com/show/6DdGLH8neJoAkggOZu4VrN William Hart’s UA-cam channel: www.youtube.com/@will3267 Danyo Pang’s UA-cam channel: www.youtube.com/@thedanyopang 00:00 That's a lot of words 00:24 Different kinds of vocabulary words 2:06 Word mapping between languages 3:16 Vocabulary goes beyond words 6:25 A sto...
The Skill of Learning from Lectures
Переглядів 41 тис.5 місяців тому
Some viewers asked for a video on learning from lectures. So I finally made one. Link to hear news on my membership site: forms.gle/2XzhvnGptxeYc28n8 Sign up to my free newsletter, Avoiding Folly, here: www.benjaminkeep.com 00:00 Starting with a question 00:53 Lectures and learning 2:10 On the popularity of the lecture format 2:56 Preparing for a lecture 4:38 Making the most of reading assignme...
40 Hours to Learn Mental Math | The riveting conclusion?
Переглядів 12 тис.6 місяців тому
It can't be true! I finally published the update to my "learning mental math in 40 hours video"! How many eons have passed? First part is here: ua-cam.com/video/uCi0_tjOiyQ/v-deo.html 00:00 Last time... 00:40 Is tracking my hours helpful? 01:08 Is the diagnostic test a good measure? 01:55 Speed vs accuracy 03:22 Interleaved vs deliberate practice 04:54 The importance of seeing progress 05:50 Mi...
How to learn from a book (maybe) | note-taking, visualizations, spacing | history example
Переглядів 61 тис.7 місяців тому
Does anyone really know how to learn from a book? Here is a record of my first serious attempt to understand and remember what I was reading for the long term, along with various justifications (and rationalizations!) for what I did. 0:00 What I'm trying to do 0:50 What does it mean to learn from a book? 2:27 Writing down themes 4:27 The back-and-forth 6:01 The function of notes 7:01 Taking pat...
Youtubers tested the generation effect. Did it work?
Переглядів 8 тис.7 місяців тому
Did UA-camrs replicate the generation effect? At first, it might not seem like it, but let's take a closer look. 0:00 This video is a follow-up video 0:39 Was there an effect? 3:12 An attempt to visualize the effect 4:36 Sources of variation 5:13 Encoding strategies and non-native speakers 7:30 Why what I just did wasn't really legit 8:14 Variation among experimental designs 10:16 A common sour...
The Experiment That Teaches People How To Learn
Переглядів 305 тис.8 місяців тому
Can you teach yourself to learn more effectively? Memory researcher Elizabeth Bjork thinks so. Participate in a short experiment that illustrates an important link between encoding and retrieval. 0:00 An introduction to Bjork's experiments 0:34 Let's try a little experiment. 4:55 Figuring out your score. 5:32 What's the expected result? 5:58 How did Dr. Bjork use this to help people learn? 7:05...
Active Control vs Passive Control in Randomized Controlled Trials | What's the Difference?
Переглядів 3,7 тис.10 місяців тому
One of the critical decisions that researchers make when designing a controlled trial is the choice of the control: what should be the control group? The answer depends on what we're interested in testing. The distinction I make here is an important one to keep in mind. 0:00 An under-appreciated distinction. 0:34 What is a passive control group? 1:36 What is an active control group? If you want...
Two Reasons NOT to Copy Memory Athletes
Переглядів 18 тис.10 місяців тому
Memory athletes use special techniques to perform amazing feats of memory. Are these techniques appropriate for classroom materials? 0:00 Memory athletes can do some amazing things 0:34 Techniques memory athletes use 1:59 The argument against using mnemonics - Reason #1 4:13 The argument against using mnemonics - Reason #2 5:50 The argument in favor of using mnemonics 8:23 Incorporating mnemoni...
Teach Your Kid Basic Math
Переглядів 4,9 тис.11 місяців тому
Teaching your kid basic math is a little more complicated than it seems. Here I go over some important learning goals and what I've tried with my own son to try to achieve them. 0:00 So... you want to teach your kid math? 0:15 Four categories of learning goals 1:35 Some important conceptual learning goals 3:14 Some important procedural learning goals 4:36 What does your kid associate math with?...
Study Less, Study Smart(er) - Extending Marty Lobdell's Study Advice
Переглядів 51 тис.11 місяців тому
Marty Lobdell's video, "Study Less, Study Smart" remains excellent advice for college students on how to study. Here are answers to some of the most common questions that come up when you follow his advice. 0:00 A brief introduction 0:23 What kinds of study breaks should you take? 1:59 Where should you study? 3:34 What kinds of notes should you take? 4:38 Deep processing, shallow processing, an...
How to Read Peer-reviewed Articles on Experiments in Learning
Переглядів 7 тис.Рік тому
Reading peer-reviewed social science research can be quite challenging. But it’s a skill that lets you go beyond media reports of the latest study. Here’s 15 minutes of advice on how to do read experimental studies specifically. 0:00 An intro to reading social science research 0:39 What do learning researchers study? 1:54 The basics of experimental designs 5:01 What’s the goal of reading resear...
How to Use Free Recall to Learn More Effectively
Переглядів 38 тис.Рік тому
People have some good questions about how to use free recall to study. Here, I try to answer them. 0:00 Is one recall mode better than another? 1:21 What should the recall interval be? 2:20 Do I need to master the material first? 2:43 Which is better, encoding or retrieval? 4:03 Is free recall just vomiting out words? 4:57 Some further thoughts Sign up to my email newsletter, Avoiding Folly, he...
What is Actually Wrong with Rote Learning?
Переглядів 12 тис.Рік тому
A lot of people don't like rote learning because it's not very fun. But is it effective? I explore this question with a rote learning example in learning to write Chinese characters. 0:00 An Intro to Rote Learning 1:01 Drawback 1 - Blocked Practice 2:57 Drawback 2 - Massed Practice 4:05 Drawback 3 - Skill Isolation If you want to be the first to know about the courses I'm releasing, sign up her...
This Simple Method Helps You Learn More from Podcasts (and Audiobooks!)
Переглядів 15 тис.Рік тому
There's a lot of great podcasts out there. But what should we do if we want to learn from them? Here's a simple method. 00:00 Some drawbacks of using podcasts to learn 01:49 Step 1 - Activate prior knowledge 02:42 Step 2 - Free recall and fill in the gaps 05:49 Step 3 - Consolidate and extend If you want to be the first to know about the courses I'm releasing, sign up here: forms.gle/px7ZmXkvJW...
The Knowledge That Underlies Everything | Tacit Knowledge
Переглядів 14 тис.Рік тому
The Knowledge That Underlies Everything | Tacit Knowledge
A Simple Way to Learn Complex Skills
Переглядів 447 тис.Рік тому
A Simple Way to Learn Complex Skills
Learn More From Every Paragraph | Active Reading Example
Переглядів 63 тис.Рік тому
Learn More From Every Paragraph | Active Reading Example
What Speed Readers Won't Tell You
Переглядів 27 тис.Рік тому
What Speed Readers Won't Tell You
Active Processing vs Active Learning | What's the difference?
Переглядів 6 тис.Рік тому
Active Processing vs Active Learning | What's the difference?
What does good learning FEEL like?
Переглядів 10 тис.Рік тому
What does good learning FEEL like?
I Learned Mental Math In 40 Hours
Переглядів 23 тис.Рік тому
I Learned Mental Math In 40 Hours
How Bad Ideas About Learning Spread | 5 Examples
Переглядів 7 тис.Рік тому
How Bad Ideas About Learning Spread | 5 Examples
3 Forgotten Studying Secrets from a 1979 Memory Expert
Переглядів 14 тис.Рік тому
3 Forgotten Studying Secrets from a 1979 Memory Expert
Learning Beyond Facts | Conceptual Knowledge, Procedural Knowledge, and More
Переглядів 21 тис.Рік тому
Learning Beyond Facts | Conceptual Knowledge, Procedural Knowledge, and More
The Most Common Obstacle to Effective Studying
Переглядів 21 тис.Рік тому
The Most Common Obstacle to Effective Studying
What Study Gurus Get Wrong About Learning
Переглядів 348 тис.Рік тому
What Study Gurus Get Wrong About Learning
How I got tricked by this one weird trick - eating, the Delbeouf illusion, and meta-analyses
Переглядів 1,5 тис.Рік тому
How I got tricked by this one weird trick - eating, the Delbeouf illusion, and meta-analyses
7 Tips For Learning Anything On Your Own
Переглядів 80 тис.Рік тому
7 Tips For Learning Anything On Your Own
The true story of the search for planet Vulcan. And what it says about science.
Переглядів 1,4 тис.Рік тому
The true story of the search for planet Vulcan. And what it says about science.

КОМЕНТАРІ

  • @akashverma5756
    @akashverma5756 32 хвилини тому

    I left the video at when he said it require a brain.

  • @PUTRIJAYA-rc4ul
    @PUTRIJAYA-rc4ul 22 години тому

    If only there was a way to read fast and comprehend it, like improving brain processing speed and power

  • @mikesmusicmeddlings1366
    @mikesmusicmeddlings1366 День тому

    I’m curious what your take is on typing/electronic note taking versus pencil/paper. I have read that handwriting tends to help retention? Do you find that to be the case?

  • @danieldoherty420
    @danieldoherty420 День тому

    In the Roman numeral problems, most matchsticks can be used to make a strikethrough of the equals sign, making it read "not equal", thus making the statement true. Easiest solution that works for all four of the problems.

  • @murrik
    @murrik День тому

    Dingenkunnendoen, WerkOmtekunnenReizenCursusen, Filmdoel, Oogensight, gevoel/salto

  • @future4830
    @future4830 2 дні тому

    Dr. Keep, i hope you will have a video on how to prepare for the bar examinations for lawyers.. thank you so much sir for your content..

  • @josephautrey954
    @josephautrey954 3 дні тому

    What about learning through reflection?

  • @ssmytheYT
    @ssmytheYT 4 дні тому

    Hey there. What are your thoughts about using the Cornell Note Taking System by Walter Pauk while watching videos? Or mixing with the technique you recommend in the video, but instead of a pure "watch through the video without taking notes", you take notes in the Cornell system? I'm curious to hear your take. Thanks! Great channel. I really appreciate your effects to distill learning theory for the curious! Have a good one. 😀

  • @banerjeehome5913
    @banerjeehome5913 7 днів тому

    Got 5 words with blanks and 4 words without blanks.

  • @StudyingMachine-yg4th
    @StudyingMachine-yg4th 7 днів тому

    How interesting! Loved it!

  • @ishrakmujibift4269
    @ishrakmujibift4269 7 днів тому

    Words without blanks : 4 Words with blanks : 6

  • @Ash.Phoenix
    @Ash.Phoenix 8 днів тому

    I hope you’re doing well Dr. Keep! I’ve been missing your content - all the best 😁

    • @User39814
      @User39814 4 дні тому

      yes he hasn't posted anything for 3 months

  • @lystic9392
    @lystic9392 9 днів тому

    I need to talk to you about something. Regarding problem solving.

  • @lystic9392
    @lystic9392 9 днів тому

    9:00 Yes I think we're more accustomed to linking age to beer than vowels to numbers. And I think because of the real life experience, beer vs water is easier to distinguish (more readily and clearly) than a consonant from a vowel or even from uneven numbers (even though that should be easy to do, it is unfamiliar). That is an interesting effect.

  • @motoboydohabbibs3153
    @motoboydohabbibs3153 9 днів тому

    Blank 8 Blank less 5

  • @deserted955
    @deserted955 9 днів тому

    I think the idea of neuroplasticity is somewhat interlinked with being a good problem solver. When you believe in a subject or problem (aligned with your abilities and the confidence that you can solve the problem ), for example a math question , if you believe that you can solve it , then your neurons (while attempting to solve that question) will signal in a way trying to find a solution to that problem - that desire to find the solution can help you create derivatives or fine fragments of the possible solution.

  • @farzivardhan
    @farzivardhan 10 днів тому

    5:29

  • @UmesShrestha
    @UmesShrestha 13 днів тому

    One of the biggest problems I see in education (esp in school education) is that many educators believe this: students don't need to memorize facts, them can google them, but we need to teach them critical thinking. I think this misunderstanding comes from articles and videos where "memorizing facts" are demonized. To be able to move towards conceptual understanding and procedural knowledge, one can not simply fact-memorizing and learning part.

  • @EngineerExpress495
    @EngineerExpress495 13 днів тому

    what do you think about mindmapping?

  • @DanielBro42
    @DanielBro42 14 днів тому

    the ending is perfect

  • @cheriviralakarthik
    @cheriviralakarthik 14 днів тому

    12 words

  • @camimejia9885
    @camimejia9885 14 днів тому

    Words with blanks 9 With blanks 6

  • @bifidoc
    @bifidoc 15 днів тому

    tooling is engineering approach. engineering is a way to automate manual efforts, therefore basically reduce it. people are lazy; laziness (in a good sense) leads to creating tools by more experienced engineers, who posses higher-level picture of the domain they operate on. to create a tool one needs to recognize patterns in that domain.

  • @lulprumpt4696
    @lulprumpt4696 16 днів тому

    this is exactly what i needed to know. i wondered if developing problem solving skills in other areas could translate to programming problems. i guess not.

  • @Abhishek-tj1cv
    @Abhishek-tj1cv 16 днів тому

    I think you should change the thumbnail of this video and maybe add Call of duty on it. It'll gain more views. The video is far more interesting than the present thumbnail.

  • @Abhishek-tj1cv
    @Abhishek-tj1cv 16 днів тому

    I have experienced this with Red Dead Redemption 2( a cowboy game set in Wild West America)it made me more curious about American history

  • @makisxatzimixas2372
    @makisxatzimixas2372 16 днів тому

    You can't really expect your brain to improve within 8 hours. You havent even slept to help it recover😅😅. At the end of the day, brain training is better than scrolling or consuming youtube. It costs more energy, thereby practices your brain.

  • @ishrakmujibift4269
    @ishrakmujibift4269 18 днів тому

    When we are encountering a totally novel problem, we should go deep into it to figure out a solution. Based on that solution we then develop a local rule and furthermore a general rule. So when we encounter a similar problem we can use the general rule to find solutions faster. However, if the problem is a little bit modified then we should use the local rule to figure ot a solution. I guess that is something I do quite often but only realised it after watching the video. Thanks :D

  • @gji2797
    @gji2797 18 днів тому

    You cannot encode something if you do not retrieve it in the first place. It's like running without using legs.

  • @Aaackermann
    @Aaackermann 18 днів тому

    Exactly my problem in school and uni. I refused at some point to take notes and started just listening. And boy did that help!

  • @aryanyavari3149
    @aryanyavari3149 18 днів тому

    my bro gained a new subscriber

  • @00_meghnath
    @00_meghnath 20 днів тому

    what about standardized tests like the lsat? i am terrible at them for some reason.

  • @theGuyWhoLovesTech
    @theGuyWhoLovesTech 20 днів тому

    Hey, I have an idea, i see free recall is great but when i do do free recall i tend to overlook the super minor facts or an unable to recall the most minute facts, plus i sometimes notice that the concepts i recall are in random order, so i thought can i do it in a way that while studying (1) i first do free recall (i miss some concepts) (2)look at the book and see the things i forgot (3)close the book and do a recall again but this time i try to do like im explaining it to someone (like the feynman method) and try to put the things in the order (plus the facts i forgot previously) so that like even a five year old can understand, its not perfectly original but would this be a good study technique to apply to my stuff?- how can i add some judgements of learning and judgments of confidence to my studies? love to have any feedback thanks for the great video :)

  • @saujanyapoudel8910
    @saujanyapoudel8910 22 дні тому

    My benchmates uses two separate notebooks taking a rough note in the lecture and making a more organised one at home yet they don't seem to grasp the concept because they just write information but not listen to understand the topic

  • @fernandokpatinde9965
    @fernandokpatinde9965 22 дні тому

    Hi, for my part, I noticed an incredible evolution following the daily use of brain game cognifit and neuronation, after 3 months. I've noticed a clear improvement, especially in reading speed, speed of execution for work tasks and better organization. Not to mention an improvement in my ability to maintain a work session without losing concentration.

  • @LeoNux-um7tg
    @LeoNux-um7tg 23 дні тому

    Mental math with inattentive adhd is just too difficult, I can calculate them as fast af on paper but once I only hear the number, they just dance in my head.

  • @sodiumraccoon991
    @sodiumraccoon991 23 дні тому

    Interesting. This makes me wonder about how to balance feedback. More/quicker/higher quality feedback seems to make for both better and worse learning given what I've come across on this part of UA-cam. I guess maybe it's just that good feedback will make sure you are learning to replicate something at the highest quality, but less feedback means whatever quality you get to in practice, you can stay at when actually being put to the test. This is very confusing because for math, I can see how finding the instructors and tutors who can explain concepts most accurately/clearly, and doing practice problems where I just check the answer if I start to struggle would help me cover a lot very fast and only train good habits, but I have also seen that people learn more from bad lecturers since they have to fill in the gaps themselves, and from not looking at the answer when they are struggling with a problem. The second option seems like it would make you do a lot of deep processing but have you go down a lot of incorrect paths that might clutter up your memory and impair your learning. I guess it's just if your skill level is close enough that you can likely solve the problem/figure out the proof/figure out a visualisation or explanation for the concept at a good quality, opt for the deep processing and do it yourself. If your skill level is far away enough from being able to accomplish your goal well, opt for tutoring so as not to ingrain bad habits. Then again worrying about bad habits too much can cripple you when just throwing a lot of shit at the wall is often the only and/or the best way of having that 'aha' moment or understanding something from new angles

  • @kidspauley2611
    @kidspauley2611 23 дні тому

    So is there a homeschool math curriculum that teaches this way?

  • @codesur
    @codesur 23 дні тому

    Great video! Thank you. I wonder if this technique is still valid in the long term. In the chat, lines seem to converge. And on the other way around, what if you can't afford/spend many sessions?

  • @User24x
    @User24x 24 дні тому

    Shouldn't we still read the info first to understand it instead of going straight to doing practice tests?

  • @jesseskellington9427
    @jesseskellington9427 24 дні тому

    Thanks for making this video it's just what I was looking for :-)

  • @0rhyan
    @0rhyan 26 днів тому

    You're amazing!!!

  • @StudyingMachine-yg4th
    @StudyingMachine-yg4th 26 днів тому

    Good idea to put information in a timeline! Makes understanding easier.

  • @StudyingMachine-yg4th
    @StudyingMachine-yg4th 26 днів тому

    Great! I´ll share these tips with my friends.

  • @ajstark7134
    @ajstark7134 26 днів тому

    My take is that test should be designed in a way in which we students can apply the knowledge check the knowledge and improve our knowledge rather than its grade marks instead after test teacher should assess or guide students where they did go wrong. New to this idea of learning but i am genuinely curious to know what is true learning and how it can be applied

  • @Rajmanov
    @Rajmanov 28 днів тому

    I miss you

  • @tomdis8637
    @tomdis8637 28 днів тому

    This has applications in music learning and especially memorization. I've never gone so far as to write my performance music down from memory but doing so would probably take my memorization to a new level.

  • @solivagant1170
    @solivagant1170 28 днів тому

    Finding this channel is like winning the lottery. If you truly internalize the information learnt here and manage to apply and refine it in a way that works for you, you’ll learn information, make sense of and retain it in a way that you would’ve never thought possible before. I don’t do this often but these videos are genuinely worth re-watching many times to truly get the point.

  • @fangfabio
    @fangfabio 28 днів тому

    From the point of view of the lecturer, should we give handouts? On the one hand, it could help with the "don't take notes" part, but, on the other, it could mess up the "do free recall" part.