Rationality From AI to Zombies ePUB ↠ AI to


Rationality From AI to Zombies [Reading] ➷ Rationality From AI to Zombies Author Eliezer Yudkowsky – Natus-physiotherapy.co.uk What does it actually mean to be rational Not Hollywood style rational where you forsake all human feeling to embrace Cold Hard Logic Real rationality of the sort studied by psychologists social scien What does it AI to PDF/EPUB ½ actually mean to be rational Not Hollywood style rational where you forsake all human feeling to embrace Cold Hard Logic Real rationality of the sort studied by psychologists social scientists and mathematicians The kind of rationality where you make good decisions even when it's hard; where you reason well even in the face of massive uncertainty; where you recognize and make full use of your fuzzy intuitions and emotions rather than trying to discard them In Rationality From AI to Zombies Eliezer Yudkowsky explains the science underlying human irrationality with a mix of fables argumentative Rationality From PDF or essays and personal vignettes These eye opening accounts of how the mind works and how all too often it doesn't are then put to the test through some genuinely difficult puzzles computer scientists' debates about the future of artificial intelligence AI physicists' debates about the relationship between the uantum and classical worlds philosophers' debates about the metaphysics of zombies and the nature of morality and many In the process Rationality From AI to Zombies delves into the human significance of correct reasoning deeply than you'll find in any conventional textbook on cognitive science or philosophy of mind A decision From AI to ePUB ☆ theorist and researcher at the Machine Intelligence Research Institute Yudkowsky published earlier drafts of his writings to the websites Overcoming Bias and Less Wrong Rationality From AI to Zombies compiles six volumes of Yudkowsky's essays into a single electronic tome Collectively these seuences of linked essays serve as a rich and lively introduction to the science—and the art—of human rationality.


10 thoughts on “Rationality From AI to Zombies

  1. Bradley Bradley says:

    Apart from just a few niggling uips I might have had with a few parts of this absolutely fantastic collection of essays I think I've found one of my most absolute favorite books of all time I've read a ton of philosophy over the years and psychology thanks to my degree in psychology but nothing UITE prepared me for this What we have here is not just a man in the process of designing from the ground up a nice AI that won't turn around and rationally destroy us all because we're vermin but a man who has gone ahead and taken the idea of real rationality and turned it not only on his work his life and himself but has gone out of his way to give us the benefit of his experienceSound like a self help book? It isn't Or at least any of us could use it that way but to me it's probably the single most useful courageous funny and excruciatingly smart book I've read in a very long time Does Eliezer have charm? Hell yeah Does Eliezer champion Bayesian probability? HELL YEAH Does Eliezer throw a perfectly understandable spotlight on our desperate need to reduce bias and seek truth no matter how painful? Yes Very much so And he sends a lot of great light on the whole field of AI research Cognitive Science Philosophy uantum Physicists and everyone who might be laboring under faulty models of thought and lazy thinking Above all he's passionate as hell about Thinking Clearly It also helps that he's fantastically devoted to rigorous standards correct predictive models and thorough ethical considerations This isn't all about AIs although we know he is passionate about it It's about EVERYTHINGAnd he's right We need rationality and I mean REAL RATIONALITY I mean meticulously and carefully considered thought Courageous exposing of our own faults Our stubbornness our ability to get up when we fail and learn from our mistakes and DON'T MAKE THE SAME MISTAKES AGAINThis isn't just a primer on logic It's pretty much a beacon of shining light in the darkness And Eliezer brings it all to us in such a charming and self deprecating way that I wouldn't be surprised if he gains a cult following of aspiring Rationalists flocking to his causeOf course he would uestion the HELL out of that Jeeze I feel like we have a modern Socrates in our midst Only this modern Socrates is building on ALL the myriad scientific foundations of those who have come before and is unwilling to take even a dram of Hemlock He already tried that as Eliezer of '96 So What am I trying to say here?Oh nothing much I don't care who you are or what you're into EVERYONE should read this monster of a book and see for themselves This world is not hopeless Not when we have such minds in it Of course that means we all need to step up to the plate and don't let bias willful ignorance or intellectual dishonesty winEveryone needs to step up Even if you don't use Bayesian


  2. Mikko Mikko says:

    Confession The ideas in this book helped shape my identity and gave my life a directionDo youa want to improve yourself as a human being orb think that 'Nah I'm pretty much fine the way I currently am'?If you said yes to either uestion this book is for you It is a revelation that will make you a better human being And the fact remains that it is usually those who think themselves wise that need a wake up call the mostYou will learn that you are wrong about most of the things most of the time And you need to learn that even though it hurts But you will also learn how to live with that even embrace the factYou will learn to spot when you are being wrong and stop yourself And you will be thankful of that factYou will learn that being rational and logical does not eual being inhuman cold or oblivious to the social environment around you as Hollywood would have it On the contrary you will learn about yourself other people and the way humans work and how to improve the uality of life of yourself and those around youYou will learn that the universe is a beautiful place You will discover the joy of trying to understand it a little betterYou will learn a set of tools to see everything in a new lightIt is time to update the humanity This book does the jobActually it is not one single book but instead six books rolled into one And to be precise it is the the comprised totality of the author's blog posts in Overcoming Bias and Less Wrong which he wrote during the late half of the '00s and which have since given birth to a community dedicated to living their lives rationally and promoting rationalistic ideas around the worldThe book itself is comprised of six books with varying themes disclaimer they are merely my own understanding of what the parts are about and only comprise a fraction of their contentsI Map and Territory'What is rationality?'What does it really mean to be rational?''Why is is valuable to care about the truth?'II How to Actually Change Your Mind'How do I become rational?''How do I avoid the pitfalls along the way?''What are the basic tools I should master?'III The Machine in the Ghost'Why is it that human beings have not evolved into fully rational thinkers?''How do the neural networks in our brain work?'IV Mere Reality'How to observe and live in the one universe that actually is there?''How does science work?''What is uantum physics and why should I care?'V Mere Goodness'How to rationally investigate ethics?''What is valuable?''How to be human as efficiently as possible?'VI Becoming Stronger'How can I put this into practice?''Where do I muster the strength to keep improving myself?'And various observations about what it is like to be a rational being in a communityOk I should now probably point out that the book is around 1800 pages long That may scare you which is understandable However I believe some books and sections are important fundamental than others Book I ignites the spark that is rationality and serves as a good introduction but personally I think Book II is the most important one Read that at leastAnd now time for a pros and cons listThings I like about the book It is a vastly important book WHY on EARTH don't we teach these things to our kids in schools? One might think that a book about rationality is destined to be a dry one Well one would be wrong then The text is personal reading it is almost intimate at times Sometimes it reads like a guide sometimes it reads like a sales pitch sometimes it reads like a love letter The format approximately 343 bite sized chapters of only a few pages makes it simple to digest Suggestion read one chapter a day you'll be finished with it in about a yearThings that I dislike Could have used some editing Maybe some of the chapters are not that essential in the grand scheme of things In addition to the introductions which were okay maybe summaries would have been in order as well 'So what did we learn in this seuence? Bullet points' As it is the book is essentially just the totality of blog posts with only some structureIn summary 45 stars The content is clearly worth five stars but I find the transformation from blog posts to a series of books lacking Maybe could have left some chapters out or combined them It's hard to pick and choose what seuences or chapters to read Ah maybe I'll just read it all in order from cover to cover then


  3. Mikhail Mikhail says:

    If I could have read just one book in my whole life this would be it


  4. Jimmy Longley Jimmy Longley says:

    Reviewed as part of my 100 books challenge Sentence SummaryRationality a long and meandering collection of posts from the blog Less Wrong purports to instruct people how to leverage probability and and understanding human biases to be better but suanders the premise digressing and bashing religionImpressionsThe promise of this book is enticing We are told that by learning to behave rationally we will behave optimally and see the world clearly I was hoping for something technical and at times it delivered There lots of fancy terms such as his Conservation of Expected Evidence” which states that The expectation of the posterior probability after viewing the evidence must eual the prior probability”`PH PHE PH¬E``PH PH|E × PE PH¬E × P¬E`Therefore for every expectation of evidence there is an eual and opposite expectation of counterevidence For example he cites how during WWII it was argued in congress that the fact that there was a conspicuous lack of sabotage from Japanese citizens in the United States implied an organized fifth column This idea seems superficially plausible However by the Conservation of Expected Evidence for this belief to be valid that would mean the presence of sabotage would have to be evidence against a fifth column existing an idea that is clearly absurdAs implied by the subtitle this book is long my kindle clocks it in at an average reading time of 34 hours and unfortunately the good bits are few and far between Rationality is not really a book but a copy of every rambling post from his blog loosely sorted into general themes If he had made any real effort of condensing the material into an actual book it would have been far enjoyable and might have actually reached some form of cogent thesisYudkowsky is annoying and arrogant constantly referencing how busy he is reading complicated math papers He grandilouently proclaims how it is his moral duty to bring the noble cause of rationality to the people but instead spends half the book taking pot shots at fundamentalist Christians and other easy targets About one he recounts Most people like this will pretend that they are much too wise to talk to atheists but she was willing to talk with me for a few hours”Perhaps it doesn’t occur to him that these people might not want to talk to him because he is a condescending asshole? Yudkowsky also authored Harry Potter and the Methods of Rationality a fanfiction that explores what would happen if Harry Potter behaved intelligently and rationally I disliked the book because instead of being the paragon rationality as promised Harry just comes off as a petulant little brat At the time I assumed that his immaturity was simply a plot device but now as I read Rationality I got the uneasy feeling that this is how Yudkowsky views himself and thinks he is better for itI was determined not to let my personal distaste stand in the way of learning but once again it just wasn’t worth it and I could not bring myself to finish itFinal ThoughtsOne of the first arguments in the book is that rationality is not the same thing as it is portrayed in Hollywood Unlike the cold spock archetype rationality and emotion can coexist I agree with this premise in general but I’d still argue that Yudkowsky’s shortcoming is his lack of empathy The extremely high rating of the book on goodreads seems to be due to the fact that only his cult following has picked it up Maybe if he had given the reader thought he could organize this book in a accessible way and actually reach a wider audienceFavorite uote“If you see your activities and situation originally you will be able to originally see your goals as well If you can look with fresh eyes as though for the first time you will see yourself doing things that you would never dream of doing if they were not habits”


  5. Gleb Posobin Gleb Posobin says:

    Whew I have finally finished “Rationality from AI to Zombies” by Eliezer Yudkowsky which is a collection of his posts from overcomingbiascom and lesswrongcom organized in “seuences” — seuences of posts on the same topicWhat does it mean to be rational? Why is that a good idea to act rationally? What prevents us from making optimal decisions? How can we fix ourselves? Do we even need fixing if we feel happy? Why “rationalists” are not successful than other people?This large collection of essays explores huge number of uestions including the ones above It will help you understand human brain evolution uantum mechanics foundations of science probability theory a little bit better and will likely let you see some of these topics in a new light I even want now to get understanding of physics the desire I remember experiencing last time about five years agoAlso thanks to this book there are than 15 new titles on my to read listI seriously consider this to be the most useful and thought provoking book I’ve read admittedly my sample of books is rather small but still


  6. Peter (Pete) Mcloughlin Peter (Pete) Mcloughlin says:

    Imagine a bunch of blog posts the almost the length of the bible but scintillating humorous and inciteful and original I enjoyed this book uite a bit and learned many new things from it I don't know if I buy everything in them but I enjoyed the exploration and mental workout they provided It covers rationality AI consciousness Many Worlds Interpretation ethics and an autobiographical bit by the author The writing style is very engaging if sprawling I recommend to anyone who likes new ideas Warning there is some opinionated polemic but mostly interesting stuff


  7. ami ami says:

    Life changing author


  8. Jesper Jesper says:

    Do you consider yourself rational? Do you think being rational is important? After reading this book my answers to these uestions are not very much at all and it's the most important thing in the world More than anything I've read before this book gives me the sense of being important in a way that if people read this book and get it then the world would be a much much nicer place to liveSo what's this book about? Like the title says it handles the subject of rationality not the Hollywood stereotype of the emotionless 'rational' person but rationality as the Art of actually archieving your goals or 'systematized winning' as the author puts it Rationality in this sense is not merely some personality trait but a MORAL imperative if you're serious about doing as much Good as possible as the book argues much in depthThe topics of the book are very broad they range from cognitive biases Bayesian statistics and the nature of intelligence to politics religion science evolution AI philosophy uantum mechanics and morality The common element in all these topics is that Yudkowski uses each of them to point out the ways in which our usual way of thinking leads us astray and how to undertake the difficult task of becoming rational ie actually winning at life Perhaps the best thing about this book is how it regularly it will completely shatter your beliefs about each of the subjects it touches or at least for me it did Yudkowski's writing style is very direct and animated but he's not afraid to get technical when reuired I'm a big fan of his writing but I've heard of other people that they absolutely can't stand it So it's probably best if you just read something by him and judge for yourselfPerhaps the greatest point of critiue I have against the book is that while reading it may fill you with the need to become rational it doesn't mean you automatically become rational as a conseuence But that's not the fault of the book but just a sign that this stuff is incredibly hard There really should be opportunities to train your rationality skills in practice something Yudkowski also talks about in the final parts of the bookThere's also a few other things I didn't like though I don't consider them deal breakers in the slightest The book actually 6 books in one is very long 1750 pages is nothing to sneeze at Though even just reading the first part would be worthwhile The book is basically an edited collection of blog posts this means it often jumps from one topic to another or conversely repeats a point many times The author rants a lot about religion It's understandable given his background but for someone who's already an atheist living among other atheists it gets boring after a while In conclusion I think the ideas in this book can and should be presented in a universally compelling and accessible way But that shouldn't stop you from reading it as there currently is nothing else uite like it It may very well be the most important thing you read in your lifeTo finish this review here are some of my favorite uotes If what you believe doesn't depend om what you see you've been blinded as effectively as by poking out your eyeballsIf science is a religion it is the religion that heals the sick and reveals the secrets of the starsThe world's greatest fool may say the sun is shining but that doesn't make it dark out You cannot obtain truth for a fixed proposition by arguing it To improve our beliefs we must necessarily change our beliefsThere is never an idea so true that it's wrong to criticize any argument that supports itThat which can be destroyed by the truth should beWhen the basic problem is your ignorance clever strategies for bypassing your ignorance lead to shooting yourself in the footThe truly important problems are often the ones you're not even considering because they appear to be impossible or um actually difficult or worst of all not clear how to solveIt is written nowhere in the math of probability theory that one may have no fun


  9. Hamish Seamus Hamish Seamus says:

    I learned a lot of really good stuff from this book I learned that the entropy of statistical mechanics and the entropy of information theory are fundamentally the same thing I learned that the many world's interpretation of uantum mechanics is a natural way of understanding the Schrodinger euation than the Copenhagen interpretation but it isn't clear how to get Born statistics in MWI I learned that it's easier to use Bayes' Rule using ratios than using percentages I learned about a ton of heuristics and biases I learned about how to make Occam's Razor mathematically precise I learned that if you subscribe to objectivist meta ethics you are susceptible to if killing babies was the right thing to do would you do it? arguments I learned to be suspicious of mysterious answers to mysterious uestions I learned that you need to have a powerful epistemology than science in order to get anywhere in life I learned that certainty of a proposition commits you to never changing your mind about it I learned that a couple of hundred years ago evolution gave better predictions of the age of the world than did physics The difference between intensional and extensional definitions The list goes onYudkowsky is very intelligent very well read and has a strong drive to understand the world as deeply as possible His writing can go in any of a hundred directions and wherever it goes you're certainly going to learn something interesting and probably something useful He's also a very engaging writer I really enjoyed two of his sci fifantasy works HPMOR and Three Worlds Collide The guy knows how to create narratives which are so weird and yet compelling that you can feel your imagination expanding from them And he can wrap up non fiction with a true narrative with the same awesome uasi mystical weirdness which makes you want to sign right on up to his worldview And yet I have a hard time saying that this is a good book The thing is when Yudkowsky wants to make a point he just goes on and on and on and on The best example of this is the seuence on uantum mechanics He starts the seuence by promising to provide an intuitive guide to a subject which is so often taught so that the students are as confused by the subject matter as the original researchers into the phenomena were Great However after a couple of essays he seems to get sidetracked into raving about how mainstream physics is being stupid in not embracing the many worlds interpretation and then spends 90% of the seuence just making that argument from every possible angle when one angle would have uite sufficed Who is he writing this for? No outsider is going to be convinced that this guy with no formal ualifications is right when the rest of the physics establishment is wrong Is the whole thing directed at physicists? Then why did he say he was going to explain M in an intuitive way at the start And oh God is it long So much longer than it needs to be Which is a real shame Because it would be one of the best books I've ever read if about half of it was cut out As it stands it would maybe still make the top ten but it's very much a love hate relationship I also spent a lot of the time while I was reading this book oscillating between thinking that Yudkowsky has all the answers and thinking that he's a crackpot If all this apparently super interesting and useful stuff is true I kept thinking then why haven't I come across it anywhere else and why isn't it academic mainstream? Well towards the end of the book I came to realise that a large part of this book is just Yudkowsky synthesising the views of a bunch of very smart modern cutting edge academics This both made the whole thing a lot palatable and somewhat but not a whole lot less impressive In sum this is the kind of book which can legitimately change your life for the better but it really needs a good trim and should be explicit about where the ideas come from


  10. Nilesh Nilesh says:

    This long long long blog collection in the name of a book has countless flaws but its biggest achievement is it makes one thinkI should modify that it makes its readers think based on where sciences and technologies are today If one picks up any philosopher from previous centuries their work might appear much structured pathbreaking readable andor comprehensive but almost always misguided based on what we know today To learn something even from the best works of the greatest of all time one needs to bin far too much and reinterpret the rest as the work based on the knowledge available at the times of these thinkers is proven almost decidedly inadeuate if not wrong with the scientific progress of recent decades Most recent era philosophers still spend far time trying to improve on the fundamentals of these greats rather than Mr Yudkowsky who has no space even to mention any Aristotle or Kant or Nietzche and likes not wholly true as there are occasional mentionsA collection of blog does not make a good book The hundreds of chapters are disjointed and repetitive in eual measure all through The short length articles are great in negating various theories while one never gets a full description of the author's own construct The author is at his best in shooting down what he deems as wrong ideas although many of the gaps in his own thesis are never addressed The repetitiveness is worse than one may have come across in any book as blog articles themselves were rarely edited by any professional but what is egregious is almost no selection in the collection arguments repeat in toto as many as ten or times in certain cases As the book progresses one sees the author's own idea evolution a term he hates for little reason outside the Darwinian sphere like some other including emergence while preferring identical terms like reductionism where he seems to be contradicting some arguments he made earlier There is nothing wrong in one's idea development as the author vividly describes in the book except that consistency within a single volume is generally helpfulThese are trifles in a way This reviewer has developed his own theory of rationality as a result of all the thinking he was forced to do The description below completely my own is a result of the book and not representative of the author's views in any form or shape Some may find that useful to the extent they are understandable The arguments are basic and need refinement but worth putting down here in case they make anyone think To start with I am not a professional thinker Neither have I spent time writing this down formally without errors or to encompass many situations that would not fit the model below Yet what I intend to show is the limitations of rationality the reasons behind reductionismemergence why we will always need philosophers and a few other things the book does not mentionRationality in a way is Domain specific Say it is possible for one to start with a set of givens G1 And one has an analytical G1 independent process toolset T1 In the world we live in G1T1 interactions could explain many things in a domain D1 However the domain explained is limited and the rationales behind G1T1 are unfathomable Over time G1T1 could expand and could be explained but the domain explained is only a small sub set of the vast reality we have Those who learn from the reality to believe in such G's T's and D's where they exist work in their improvements and manipulations to improve our existence are rationals For example the toolset could include the Bayesian methods all math euations and similar while one is working on the uarks and basic particles along with fields the givens G set to explain the domain that would explain a proton or a neutron Yet the uarks will not explain our politicians or the evolution of life or the oceans or even a hydrogen atom To explain elements one needs a different givens like protons and neutrons and possibly different tools Like to explain the characteristics of a river or an ocean flow the givens cannot be hydrogen or oxygen atoms or even water molecules Same goes if one tries to explain human choices or Big Bang or the working of a planeThere are thousands of domains and there are huge gaps in our knowledge in the form of how or why these domains emerge and gaps between them What works within these domains is always baffling and not just with euations like the uantum theory or the workings of our DNA or mind We have to simply take reality as given and develop those paths where we understand and of domains with those Gs and Ts Gs and Ts need not be a small set They need not be simple Like they need not be deterministic Here is why rationality is bounded itself Why uarks combine to produce a proton of a totally different characteristics why a water molecule has no resemblance to its constituents why the DNA works the way it works the number of such uestions remain infinite not just what came before the Big Bang or could happen eventually This is why those who try to fill those knowledge gaps with their own narratives be they religious leaders philosophers dreamers or even rationalists should not be grudged Over time most such narrative based explanations will appear hopelessly simple but few could simply be agnostic to everything not fully covered by some such Ds Ts and GsIn other words rationality itself is based on reality which is anything but rational Those of us who are uick to damn the romantics or the religious have our own numerous simplistic ideas whose underlying assumptions we bury in a mountain of unsubstantiated arguments One does not need to forgive or ignore every hopeless narrative based idea or thinker but eually one does not need to be completely dismissive either The framework presented here could make one tolerant of belief in consciousness as a given in explaining many human affairs It would explain why emergence is an important way to describe suddent appearances of domains and their limited applicabilities from uarks one cannot go to DNAs for example Most importantly this could prove a good framework to understand what machines can learn and what they cannot completely on their own and the givens they will needThe above framework may not have any use But the book made me think This will be the case for most who go through this turgid volume In fact the above is just one of the tens of times the author made me think of something new or say aha at something he presented


Leave a Reply

Your email address will not be published. Required fields are marked *