개 훈련의 도파민: 기대감, 보상, 그리고 가치 이전 #174

it throws you all off, but it's okay. When it's less than what they expected, then that's actually a negative prediction error. And what happens, it shuts down dopamine production for a short period of time. And when it's equal to what they expected, they don't get any dopamine for that moment. So, when it's greater than they expected, that's what gives the dopamine release. I'm going to give a link in the show notes to a video that is narrated by Dr. Robert Sapolsky, who is, I believe at Stanford University. He was sharing this experiment where they had a cue and a behavior and then a reward. And what they were measuring when the dopamine release happened and how high that dopamine spike was. The cue was a light. Light would turn on and that meant that the animal could now press a lever. If they press a lever 10 times, a reward would come out. And as long as that light was on, they could keep pressing that lever. And when they got to 10, they would get a reward. They expected that the dopamine spike would happen when the animal got the reward, but that's not what happened. What happened was as soon as the light came on, the animal then knew, game on, and the dopamine spike happened then and stayed up the entire time that the animal was working. And it only dropped when they actually got the reward, which you think is weird, right? Other literature showed that when an animal was given a reinforcement, I don't know why in all of this literature, they talked about rewards rather than reinforcement. When the animal was given the first reinforcement, they were like, wow, this is good. Thank you. And they got a dopamine spike. But if the reinforcement was of equal value after that, or it was what they predicted, then they didn't get a dopamine spike. Kind of like if, you know, I was lecturing at your favorite dog training conference and it was like in person, not these online varieties. You saw me and I was talking to somebody and you kind of came up and tapped me on the shoulder and said, Hey, Susan Garrett, I got you one of these awesome vegan chocolate chip cookies. Well, at first the tap on the shoulder, I'd go, okay, I'm talking to somebody. Oh, vegan chocolate chip cookies. Well, thank you. And that would be great. I'd get a dopamine spike. This is awesome. And then a little later on, if you tap me on the shoulder and you said, Hey, I got another one of these vegan chocolate chip cookies. Oh, cool. I take it. And this one had nuts in it too. Wow. My favorite. Boom. Another dopamine spike. And then later the tap on the

shoulder, I would get excited already because two big hits. Yeah. The tap starts predicting the dopamine spike. And that's exactly how it was written out in one of Dr. Schultz's most recent paper. So, as Dr. Schultz says, this is a little bit jargon heavy, but I'm going to repeat it with another quote from another great scientist. Dr. Schultz said, the dopamine response is transferred to the next preceding reward predicting stimulus, the Q. And ultimately to the first predictive stimulus. So, if there's more than one things in the chain, you can put a chain of things, then guess what? It also gives you a dopamine hit. All right. So, I'm going to give you another quote from Dr. Mark Humphreys. He's a neuroscientist at the University of Nottingham. The key to dopamine theory isn't just that the dopamine neuron signals the difference between the reward you got versus the reward you expected. It is that they also transfer that signal to unexpected things that predict rewards. AKA the transfer value that I've been talking about on pretty much every single one of these podcasts, right? The transfer of value, the thing before the thing. You pull out a clicker and your dog says, there's a dopamine spike because it means game on. You pull out a target, there's a dopamine spike because it means game on. You pull out a food lure, that's the same. So, you might get a dopamine spike the first time the dog tastes it, but you're not going to get, it's then neutral. And that's exactly the question I asked of Steven Lindsay back in 2012 when he first presented the original work of Dr. Schultz. I went down after the lecture was over, I went to the front of the hall and I said, listen, can I ask you a question? That paper that you presented, does that not mean dogs who are trained with lures are not going to get the same amount or frequency of dopamine spikes as dogs whose behaviors are shaped? And he said, in my opinion, a hundred percent. So, you know what? I always look at these papers and go, Susan, you're looking through your own colored lens. There's confirmation bias in all of us. But time after time, I'm reading the same thing. And it makes sense to me because that's what I'm seeing in my dogs and in the dogs that I'm helping to train my students' dogs, whether they be online or in person. Another really interesting thing that these scientists did is they then blocked dopamine production. And when they did that, what they found is the animal's motivation to work went in the crapper. One experiment, they had a corridor where a rat could walk down an experiment

and if they turned right, there was a pile of food for them. If they turned left, there was a pile of food, double the size. However, there was a small little hurdle that the rat had to go over in order to get to that double the size of food. Now, when they suppressed dopamine production in the rat, they always went to the little pile. Oh, that means it's too much effort. I can't go and do that one. But with a normal functioning rat, with a normal level of dopamine production, they always went to the left. They always said, I can take that little hurdle. I'll take that in one leap. And off they went and ate the bigger pile of food. And so, how does that affect our dogs? Well, we know in humans, humans with a suppressed dopamine level, they will suffer from things like inability to focus or depression, lethargy, possibly socially withdrawn, all of that because of low levels of dopamine. And the same can be seen in our dogs. So, dogs that are in physical pain or have endured some chronic stress or have been sick, those dogs, their level of dopamine has been suppressed. Their ability to create a dopamine hit is hampered. And so, that's why you take a dog who's not feeling well and you ask them to tug or play a game with you, they're going to be half-hearted. Or what you'll find is they might play one time, but the first time they fail and you get that negative prediction error, they're tapping out. No. The little dopamine that's there shuts right down. They can't work. I've seen that myself in my youngest dog, this, who's been dealing with a gut issue since the day she was born. And so, I have to be very, very particular about how I train her. In addition, I'm going to share with you that there's nutrition that is involved in dopamine production. So, dopamine is relying on the amino acid tyrosine in order to be produced. Now, tyrosine is naturally occurring in a lot of foods, including poultry, chicken, turkey. It's found in bananas, which by the way, also have dopamine in them. Funny thing. I love bananas. Maybe that's why. It's found in pumpkin seeds. My dogs routinely get one and a half teaspoons of ground pumpkin seeds. If you don't grind those pumpkin seeds, you will be visiting them once again on their way out because they do not digest in your dog unless they've been ground. Avocado is another source of tyrosine and you can feed your dog small amounts of avocado. Again, you know, you might want to check with your nutritionist or your veterinarian before you change your dog's diet. But those are

things that contribute to the dog's ability to produce dopamine and to produce that dopamine spike. Now, what about if we go on the opposite spectrum? There is such a thing as having too much dopamine. And you will see that I personally believe that that was a struggle that my long gone now dog Buzz struggled with. And Buzz, you may know, I wrote a book about him called Shaping Success. He was an awesome dog, but he was a little bit high, like a lot high. Now he came to me as an eight-week-old puppy. He never would settle. He was always running around. He was a bit cray-cray back then. But back in 1996, when Buzz came on the scene, I had made a commitment that I wanted to train my dog in obedience and agility without the use of any physical or verbal corrections. I had made that transition with my dog before him, Twister, when she was about two, but this was my first dog from a puppy on up. I was going to do it just all with Shaping Behavior. Nobody was doing this back then. Nobody was doing it in sports, that's for sure. And so, I was the pioneer making a ton of mistakes. And the biggest mistakes that I made was in my experimental design and how I set up my training environments and how many mistakes Buzzy made. And so, what he would do, it wasn't that okay, it must be this, I'm going to try this. And every time he failed, he would get another dopamine hit because he was one step closer to getting it right. And so, Buzzy was on such a random schedule of your right that he could get higher and higher and higher. So, too much dopamine in the body and what can happen is that you get frantic behavior, frenetic behavior, the inability to relax, the, oh my gosh, I got to do something. I got to do something. In Buzzy, I always described him as a dog who worked hard and then crashed. And so, looking back, I believe he was a dog who maybe had too much dopamine in his body. And one of the things that I do with my own dogs, kind of as a detox, as you may know, if you're a listener to this podcast, I love to take my dogs for walks. And my dogs, three of them border collies, love to run and hurt each other and chase each other. And that goes on for almost the entire walk. Well, at least one day a week, I will have them not do all of that ripping. You're just going to walk and you can sniff. And I don't put them on leash, but I tell them with me and they just have calm walks. It's like our dopamine detoxing walk once a week. So, you might identify with your dog in one of those two categories. And so, you might need

to make adjustments one way or the other. But the most important thing I'd like to encourage you to think about is, is your training addictive to your dog? Is your dog getting healthy dopamine spikes throughout the training? Because if you're training with a food lure, there's a very good chance the first time they get that bite of food, they are going to get excited and get that dopamine hit. But if it's the same food for the rest of your training, it's now neutral. So, it's harder for that training to become addictive. And that could be a reason why your dog might not be as addicted to your training as you would like them to be. And finally, as long as we're on the topic of dopamine, why don't you go and grab yourself a banana or a handful of pumpkin seeds, maybe a chicken leg and jump on over to iTunes or wherever you're listening to this podcast and go ahead and leave us a favorable review. You know, that's going to give me a dopamine hit. And if you're watching this on YouTube, you know, I love reading your comments. I'll see you next time right here on What Shape by Dog.