Preference for small instant reward over large delayed one?

Page 1 of 1 [ 15 posts ] 


Which problems do you experience?
All four, 1 ) 2 ) 3 ) and 4 ) fairly severely, even disablingly 15%  15%  [ 2 ]
Mainly 1 ) and 2 ) fairly severely/disablingly but also 3) and 4 to some extent 15%  15%  [ 2 ]
Mainly 3 ) and 4 ) fairly severely/disablingly but also 1 ) and 2 ) to some extent 0%  0%  [ 0 ]
All of them to some extent, but not so severely 0%  0%  [ 0 ]
Really only 1 ) and 2 ) to some extent 15%  15%  [ 2 ]
Really only 3 ) and 4 ) to some extent 0%  0%  [ 0 ]
All or most of them but only mildly 0%  0%  [ 0 ]
One or two of them but only mildly 0%  0%  [ 0 ]
None of them, or only very infrequently 54%  54%  [ 7 ]
Other 0%  0%  [ 0 ]
Total votes : 13

ouinon
Supporting Member
Supporting Member

User avatar

Joined: 10 Jul 2007
Age: 61
Gender: Female
Posts: 5,939
Location: Europe

05 Nov 2010, 7:56 am

Fructose, Tryptophan, Serotonin, Mood and Cognition.

1 ) Do you tend to prefer/prioritise small immediate rewards over larger delayed rewards?

2 ) Do you tend to discount or undervalue longer-term rewards?

3 ) Do you often have trouble connecting negative consequences to actions taken more than a few hours or days beforehand?

4 ) Do you often have trouble understanding or imagining or correctly evaluating the consequences and implications of your actions?

I just found some interesting information about the effect of low tryptophan on mood and cognitive function, especially likely in those with fructose malabsorption, ( because unabsorbed fructose binds to tryptophan in the gut making it unavailable ), and apparently as many as 40% of people have low to very-low fructose absorption capacity, and/or in those on vegan/casein-free vegetarian diets, ( because the best sources of tryptophan are meat, cheese, fish and eggs ):

Tryptophan is a necessary/essential requirement for the production of serotonin in the brain.

From the Yahoo Fructose-Malabsorption and FODMAP intolerance chat list I recently joined:

Yahoo-Fructose-Malabsorption-and-FODMAP-Intolerance-Chat-list wrote:
The technical term for typical tantrums and loss of social inhibition in children and adults (clinically) is 'delayed reward discounting' - that is, the tendency to prefer a short-term low-value reward over a more distant high-value reward.

Short-term greed and urgency for immediate response is favored when serotonin levels are low ( and emotional reaction tends to be out of scale for the short-term reward too, hence the tantrums ). One of the key points in the studies on this is that the researchers induced low serotonin levels by DIETARILY reducing tryptophan in healthy adults, in order to test the behavioral results.

A good one on this: The Journal of Neuroscience, April 23, 2008, 28(17):4528- 4532; doi:10.1523/ JNEUROSCI. 4982-07.2008;

"Low-Serotonin Levels Increase Delayed Reward Discounting in Humans".

Nicolas Schweighofer, 1 Mathieu Bertin,2,5 Kazuhiro Shishida,3 Yasumasa Okamoto,3 Saori C. Tanaka,2 Shigeto Yamawaki,3 and Kenji Doya2,4 : "

"Previous animal experiments have shown that serotonin is involved in the control of impulsive choice, as characterized by high preference for small immediate rewards over larger delayed rewards. Previous human studies under serotonin manipulation, however, have been either inconclusive on the effect on impulsivity or have shown an effect in the speed of action–reward learning or the optimality of action choice.

Here, we manipulated central serotonergic levels of healthy volunteers by dietary tryptophan depletion and loading. Subjects performed a "dynamic" delayed reward choice task that required a continuous update of the reward value estimates to maximize total gain. By using a computational model of delayed reward choice learning, we estimated the parameters governing the subjects' reward choices in low-, normal, and high-serotonin conditions.

We found an increase of proportion in small reward choices, together with an increase in the rate of discounting of delayed rewards in the low-serotonin condition compared with the control and high-serotonin conditions. There were no significant differences between conditions in the speed of learning of the estimated delayed reward values or in the variability of reward choice.

Therefore, in line with previous animal experiments, our results show that low-serotonin levels steepen delayed reward discounting in humans. The combined results of our previous and current studies suggest that serotonin may adjust the rate of delayed reward discounting via the modulation of specific loops in parallel corticobasal ganglia circuits."

4) Other behavioral implications of low serotonin that have been researched already:

S. C. Tanaka, K. Shishida, N. Schweighofer, Y. Okamoto, S. Yamawaki, and K. Doya

"Serotonin Affects Association of Aversive Outcomes to Past Actions"
J. Neurosci., December 16, 2009; 29(50): 15669 - 15674.

(That is, punishment or negative consequence that is at all delayed from the action makes increasingly less connection when serotonin is low )

A. B. Long, C. M. Kuhn, and M. L. Platt

Serotonin shapes risky decision making in monkeys
Soc Cogn Affect Neurosci, December 1, 2009; 4(4): 346 - 356.

( The implications of choices are less well understood when serotonin is low )

So... kind of important to have serotonin! Especially for kids. You can find a lot more by entering 'low serotonin' into Google Scholar...

Some other implications of low serotonin:

* Excess fatigue
* Appetite loss or increased consumption of certain food items
* Disrupted sleep pattern
* Depression and anxiety
* Irritability and frequent crying spells
* Increased sensitivity to pain
* Migraine attacks
* Reduction in insulin production
* Poor memory and diminished ability to learn
* Decreased sexual desire
* Depression associated with rage outbursts
* Place memory challenges (may influence sense of direction)
* Eating disorders (especially bulimia in girls)
* Impulsivity and OCD
* Responsiveness to behavioral therapy (such as for PTSD)
* suicide risk
* Alcohol dependence (for helping modulate emotional reactions)

* Hot flashes (though this may be related to an imbalance between the two serotonin locations, so may have a different cause).


I'm thinking that this suggests a possible connection between the massive increase in fructose consumption the last 50 years and the increasingly widespread and destructive tendency to short-term thinking that is more and more evident in society as a whole, aswell as the disabling individual difficulty with correctly weighing up small instant rewards against larger long-term rewards which so many people ( myself included ) have experienced, and suffered from, for so much of their lives. ie. Chronically poor judgement in one of the most important areas of functioning.

Fructose malabsorption is a question of limits/tolerance levels; apparently as many as 40% of people have low to very low fructose-absorption capacities.

The best sources of tryptophan are ( in order and by weight ): dry hard cheeses; meat especially pork and poultry; fish especially salmon and tuna; eggs, other dairy produce, seeds and nuts and pulses.

Eating more than a small amount of fructose at the same meal or within four or five hours as the above foods is likely, in as many as 40% of people, to significantly reduce the amount of tryptophan which is absorbed and converted to serotonin.

Foods highest in fructose are apples, pears, honey, very sweet fruits, and anything containing high-fructose corn-syrup. Foods high in fructans, which may have a similar effect on tryptophan uptake are wheat, rye, onions and leeks, and chicory, aswell as brown rice.

.



ouinon
Supporting Member
Supporting Member

User avatar

Joined: 10 Jul 2007
Age: 61
Gender: Female
Posts: 5,939
Location: Europe

05 Nov 2010, 8:27 am

It's taken me years to understand and accept that I have this problem.

I used to think my parents were simply being unkind or intolerant or hostile when they said that I seemed to have no imagination! Me!? No imagination, who wrote stories, drew made-up faces, daydreamed for hours etc!! ! ??? ! !! :shock: But I have realised, many years later that they were right. :oops:

They also said I was greedy, impatient, and had eyes bigger than my belly, and bewailed my ( disastrous, self-sabotaging ) inability to stick to anything, to value or even remember anything, which didn't bring me nearly instant positive results, of some kind or other.

It has been a major blight, most of all when I didn't realise it about myself, and thought that I was making good decisions, having already forgotten the negative results of many of my other choices, and I thought that the reason I was so often disappointed by the results/consequences of things I chose to do was because life itself was disappointing, and ended up depressed, when in fact it was just that I kept making bad decisions.

I have so chronically repeatedly failed to learn lessons from bad experiences, and so chronically felt optimistic about new starts, new endeavours, only to find that they don't work out, again.

And been so unable to do anything at all, ( apart from brush my teeth ), if it didn't reward me almost immediately in some way, within the next 24-48 hours. Long-term training or work-projects totally out of my reach, even if intellectually I *should* have been able to do them.

Exams passed on pure "off the top of my head" logical capacities and exceptional memory and wide reading, not study. And studying only that which interested me in the moment, diet, for instance! :lol But making even a nutritionist's diploma seem unappealing because so much on the course didn't interest me *then*.

It has affected everything. And it is only in the last 7 years or so since I have begun to recognise and accept and understand this problem that I have begun to be able to avoid the sort of traps this "blindness"/poor judgement kept leading me into ... ... ... mainly by doing very little, by being very very careful, by staying put, and when attempting anything out of the ordinary/humdrum/daily routine making sure I have support structures and a solid framework in place to sustain my effort.
.



ouinon
Supporting Member
Supporting Member

User avatar

Joined: 10 Jul 2007
Age: 61
Gender: Female
Posts: 5,939
Location: Europe

05 Nov 2010, 9:41 am

The thing is that for a very very long time I didn't even realise that I was "discounting" or "undervaluing" "delayed/future rewards ( or possible negative consequences )", etc.

I didn't realise that my judgement was off, that instead of seeing the whole forest/wood clearly/relatively accurately I was only seeing the trees in front of me at their right size.

I didn't seem to be able to factor in that it was simply distance/time that made the other "trees"/delayed rewards look smaller; to me they were literally smaller, as if time was "flat" like a canvas and I a person who had never learned the rules of "perspective".

PS. Like I've had astigmatism all my life, and only found out why I kept bumping into things a few years ago.
.



wavefreak58
Veteran
Veteran

User avatar

Joined: 26 Sep 2010
Age: 66
Gender: Male
Posts: 4,419
Location: Western New York

05 Nov 2010, 10:13 am

I think my reward system is broken. I can't seem to even wrap my brain around the question. There seems to be some inherent contradictions in my behavior. When hyper-focused on something, there is no thought of reward and I can go for hours in an almost trance. When my attention is diffused (like in social environments) is seems to be involved in navigating the situation, almost like survival mode. I also don't think of reward in any normal context. I look for resolution of internal states, not some external measure (money, things, awards). My rewards are geared towards the reduction of cognitive dissonance caused by conflicting information.



richardbenson
Xfractor Card #351
Xfractor Card #351

User avatar

Joined: 30 Oct 2006
Gender: Male
Posts: 13,553
Location: Leave only a footprint behind

05 Nov 2010, 10:22 am

I perfer larger delayed rewards. in two years i'll be able to make a custom made fire agate ring but first i have to save up my moneys.
its a good thing i know nothing is gained without sacrifice!! :pig:


_________________
Winds of clarity. a universal understanding come and go, I've seen though the Darkness to understand the bounty of Light


Moog
Veteran
Veteran

User avatar

Joined: 25 Feb 2010
Age: 45
Gender: Male
Posts: 17,671
Location: Untied Kingdom

05 Nov 2010, 12:04 pm

I voted really only 1 ) and 2 ) to some extent.

Is it the food though?


_________________
Not currently a moderator


Sallamandrina
Veteran
Veteran

User avatar

Joined: 24 Jan 2009
Gender: Female
Posts: 3,590

05 Nov 2010, 12:41 pm

I rarely get motivated by rewards these days and quick gratification became a turn-off...

But I have no merit in this, especially with food. I have very high standards about the quality of my food, but don't eat that much, never really liked sweets and don't get cravings...


_________________
"Selfishness is not living as one wishes to live, it is asking others to live as one wishes to live" (Oscar Wilde)


DandelionFireworks
Veteran
Veteran

User avatar

Joined: 16 May 2010
Gender: Female
Posts: 2,011

05 Nov 2010, 1:44 pm

I only notice #4-- that I have difficulty determining what the consequences of my actions will be. And then, only when those consequences are things other people do. That is to say, I don't have trouble determining what's likely to happen if I have all of the information (big if), EXCEPT that people tend to react to me with offense or worse regardless of what I say or do, and I generally fail to predict when or how that will happen (though I've learned to expect that it will).


_________________
I'm using a non-verbal right now. I wish you could see it. --dyingofpoetry

NOT A DOCTOR


Plywood
Deinonychus
Deinonychus

User avatar

Joined: 7 Jun 2010
Age: 33
Gender: Male
Posts: 318

05 Nov 2010, 2:29 pm

I have been taking omega three fatties and it has helped me with everything overall. Especially confidence, anxiety, depression and focus.



Kaybee
Veteran
Veteran

User avatar

Joined: 6 Oct 2009
Age: 39
Gender: Female
Posts: 3,446
Location: A hidden forest

05 Nov 2010, 5:55 pm

I tend to undervalue small, instant rewards.


_________________
"A flower falls, even though we love it; and a weed grows, even though we do not love it."


Callista
Veteran
Veteran

User avatar

Joined: 3 Feb 2006
Age: 41
Gender: Female
Posts: 10,775
Location: Ohio, USA

06 Nov 2010, 5:18 am

I think long-term to the extent that I ignore the present. I pretty much ignore the time interval until I get something; if I'm getting it, then that's really all that matters to me. I don't really have much of a concept of time or delay.

For example, I will easily forget to eat if I happen to be doing something else; the immediate reward of food isn't nearly enticing enough to get me to switch tasks until I've missed two or more meals. (Though this is generally a bad idea; if I don't schedule meals, and forget to eat, then I will eat too much at the next meal, which is not healthy.)

I also have no problem waiting for several months to read a book from a favorite series, until the book is available in the library; and I don't play computer games the year they come out--in fact, my average wait tends to be more like four or five years after they come out, when they are generally quite inexpensive and within my budget to buy. (I recently purchased Baldur's Gate for $5.)

My problem with task-switching isn't a reward issue; it's simply inertia. If I'm doing something, I keep doing it, whether it's pleasant or not. The other day I got a sore arm because I started off scrubbing dirt off the walls and just kept on scrubbing until all the walls were clean. Yeahhh... somebody get me the Advil!

My inability to make impulsive decisions often leads to choice overload and "lockup" when I have to try to choose between a lot of different options without a mental flowchart to sort them. I think I'd be better off if I were more impulsive. Oddly enough I am classic ADHD-I, with all the daydreaming and disorganization that involves; but it's not like I can't pay attention--I just can't control where my attention goes.


_________________
Reports from a Resident Alien:
http://chaoticidealism.livejournal.com

Autism Memorial:
http://autism-memorial.livejournal.com


ouinon
Supporting Member
Supporting Member

User avatar

Joined: 10 Jul 2007
Age: 61
Gender: Female
Posts: 5,939
Location: Europe

07 Nov 2010, 4:22 pm

Very interesting results, and posts.

I could have sworn that a lot of people on the spectrum had this problem, like you describe, Callista, of ignoring the long-term rewards, ( of eating, for example, with its effect on ones health, etc ), in favour of present gratification, ( like you describe ), the moment that one is in, whatever is immediate and present, to hand or already in one's hand.

I expected a lot of people to vote for the first few options, because I have got the impression, in the three odd years I've been on WP, that a great many people here have trouble moving from something that they are already doing, something with which they are already involved, to something else even if that thing is important to their health, finances, or job prospects, etc. ie. they will stick with the reward of the familiar the already understood and mastered etc over something with deferred rewards, something which will be difficult to do to begin with but which promises greater rewards over time.

The number of people on WP who have trouble leaving the computer to do anything else, for instance.

Rewards don't need to be money, things, etc, as wavefreak58 seemed to think, but also the "resolution of internal states" for instance that you mentioned, wavefreak58. ie. I have got the impression that a great many people on WP will put the resolution of immediate states of discomfort over any possible future reward, however big, eg. an even more permanent, and at the same time productive, way to resolve internal discomfort, which some temporary discomfort now could lead to.

Am definitely puzzled that so few people here voted for the first few options, except when I think how totally invisible this tendency was to me, for so many years. In other words if someone had asked me to vote in this poll twenty years ago I too would have thought that it did not apply to me.
.



Moog
Veteran
Veteran

User avatar

Joined: 25 Feb 2010
Age: 45
Gender: Male
Posts: 17,671
Location: Untied Kingdom

07 Nov 2010, 5:38 pm

ouinon wrote:
I expected a lot of people to vote for the first few options, because I have got the impression, in the three odd years I've been on WP, that a great many people here have trouble moving from something that they are already doing, something with which they are already involved, to something else even if that thing is important to their health, finances, or job prospects, etc. ie. they will stick with the reward of the familiar the already understood and mastered etc over something with deferred rewards, something which will be difficult to do to begin with but which promises greater rewards over time.

The number of people on WP who have trouble leaving the computer to do anything else, for instance.


I have this, fo sho.

Quote:
I have got the impression that a great many people on WP will put the resolution of immediate states of discomfort over any possible future reward, however big, eg. an even more permanent, and at the same time productive, way to resolve internal discomfort, which some temporary discomfort now could lead to.

Sounds like meditaiton practice.

Quote:
Am definitely puzzled that so few people here voted for the first few options, except when I think how totally invisible this tendency was to me, for so many years. In other words if someone had asked me to vote in this poll twenty years ago I too would have thought that it did not apply to me.


Perhaps people misunderstood the poll, the questions, whatever. You do go in for very complex stuff, ouinon. Not that I mind. I share your curiosity. Maybe you can streamline it a bit. I'm sure a lot of people would take a look at your enormous OP and then go for the familiar and easy reward of something simpler.


_________________
Not currently a moderator


Clyde
Deinonychus
Deinonychus

User avatar

Joined: 25 Aug 2010
Age: 34
Gender: Male
Posts: 337

07 Nov 2010, 6:07 pm

I like larger delayed rewards myself.

Small rewards are nice, but the satisfaction only last for a short while.



gramirez
Veteran
Veteran

User avatar

Joined: 9 Nov 2008
Age: 30
Gender: Male
Posts: 1,827
Location: Barrington, Illinois

07 Nov 2010, 6:15 pm

I much prefer smaller, more frequent rewards. I don't have much patience, and I can't stand the suspense of waiting - even waiting for something small to ship is hard. I'd rather get a $5 item every week or so, than get a $100 item once every couple of months.


_________________
Reality is a nice place but I wouldn't want to live there