Thursday, February 16, 2012

A machine that can dream










Note: This takes 20-30s to load, supported browsers are Chrome,  Safari 4.0+, 
Firefox 4+, Opera 10.0+. It requires heavy computations.

This is a live demo of a type of Boltzmann machine in Javascript. The evolving image at the bottom is what the machine is thinking and the flickering lights are the state of its neurons. This particular machine has been shown thousands of faces, and now it imagines faces when it dreams.

The Boltzmann machines have a remarkable ability similar to dreaming. They were first introduced by Geoff Hinton and Terry Sejnowski as a model of the brain in 1983. They can discover patterns when they are learning from data. And when run in a closed loop they can generate or dream new examples based on what is has learned.




How do they work? The full answer is beyond the scope of this post, but for motivated readers here's a quick explanation focusing on the restricted Boltzmann machine (RBM). It is defined by its so-called energy function
$$E({\bf v}, {\bf h}) = - \sum\limits_{i,j} v_i h_j w_{ij}$$
This function measures the energy between a sensory input vector \({\bf v}\) and the state of each neuron \({\bf h}\). The parameters \(w_{ij}\) weight correlations in the data. This is used to define the probability
$$p({\bf v}, {\bf h}) = \frac{e^{-E({\bf v}, {\bf h})}}{\sum\limits_{{\bf v}',{\bf h}'} e^{-E({\bf v}', {\bf h'})}}$$
where the denominator is the summation of the energy of all possible configurations of inputs and brain states.

Learning consists of adjusting \(w_{ij}\) to maximize the probability the RBM assigns to what you show it. This will make the neurons detect patterns in the sensory input. Dreaming consists of traveling in probable sensory inputs and brain states using Markov Chain Monte Carlo (MCMC).

If you want to know more about Boltzmann machines and Deep Learning, you should checkout this excellent talk by Geoff Hinton, or you can read this introductory paper by Yoshua Bengio and Yann LeCun.

You can also find here a pythonic implementation of the binary restricted Boltzmann machine (RBM) that I wrote.

98 comments:

Mentifex said...
This comment has been removed by a blog administrator.
Unknown said...

Muito bem yann, novo e já com um futuro excepcional só posso parabenisa-lo e desejar-lhe um futuro promissor, pois o mais difícil você já fez. Ventura!!!.

Unknown said...

Pleasy. Ventura!!!.

Unknown said...

The material of the essay is also extremely crucial. For essays, content that is informative is a need to. Filling the webpages with fluff words merely to meet up with the web page prerequisite will land you a poor evaluation and some severe criticism. Consequently, when you really feel like you have operate out of items to say, attempt carrying out a little bit much more custom research papers study. There is often something else that you forgot to mention, or possibly go back and elaborate on one thing you spent little time on. Filler terms are never an excellent selection.

Simone said...

Amazing and inspiring work, at least to my uninitiated eye. My area of studies is far from machine learning, but I am fascinated by this field and I'm trying to wrap my head around the main concepts in my spare time. Projects like this are my main source of motivation!

Anonymous said...

i really thanks for sharing this blog..
goldenslot

Sean Parker said...

Would be a great step towards artificial intelligence.
airport parking gatwick

ganga.besant said...

Excellent post!!!. The strategy you have posted on this technology helped me to get into the next level and had lot of information in it.
Block Chain Training in Bangalore

Block Chain Training in tambaram

Block Chain Training in chennai

Block Chain Training in annanagar

Block Chain Training in pune

Block Chain Training in velachery

genga g said...
This comment has been removed by the author.
LENIN said...

I found this informative and interesting blog so i think so its very useful and knowledge able.I would like to thank you for the efforts you have made in writing this article.
Data Science course in Chennai | Data science course in bangalore
Data science course in pune | Data science online course
Python course in Kalyan nagar

Unknown said...

I found your blog while searching for the updates, I am happy to be here. Very useful content and also easily understandable providing.. Believe me I did wrote an post about tutorials for beginners with reference of your blog. 
java training in jayanagar | java training in electronic city

java training in chennai | java training in USA

Unknown said...

A very nice guide. I will definitely follow these tips. Thank you for sharing such detailed article. I am learning a lot from you.

rpa training in electronic-city | rpa training in btm | rpa training in marathahalli | rpa training in pune

gowthunan said...

I’d like to write some material for your blog in exchange for a link back to mine. Please shoot me an email if interested. Thanks.
safety course institute in chennai

cynthiawilliams said...

Learned a lot from your blog. Good creation and hats off to the creativity of your mind. Share more like this.
Blockchain Training Institutes in Chennai
Blockchain course in Chennai
AWS course in Chennai
AWS Certification in Chennai
Python Training in Chennai
Python Classes in Chennai

Anbarasan14 said...

I believe that your blog will surely help the readers who are really in need of this vital piece of information. Waiting for your updates.

French Class in Mulund
French Coaching in Mulund
French Classes in Mulund East
French Language Classes in Mulund
French Training in Mulund
French Coaching Classes in Mulund
French Classes in Mulund West

Sadhana Rathore said...

Thanks for taking time to share this valuable information admin. Really informative, keep sharing like this.
Appium Training in Chennai
Best Appium Training institute in Chennai
Appium Certification in Chennai
Mobile Appium Training in Chennai
Mobile Appium course in Chennai

Aruna Ram said...

Very creativity blog!!! I learned a lot of new things from your post. It is really a good work and your post is the knowledgeable. Waiting for your more updates...
Blue Prism Training Institute in Bangalore
Blue Prism Course in Bangalore
Blue Prism Training Bangalore
Blue Prism Classes in Bangalore
Blue Prism Course in Adyar
Blue Prism Training in Mogappair

LindaJasmine said...

Amazing Post . Thanks for sharing. Your style of writing is very unique. Pls keep on updating.
Spoken English Classes in Chennai
Best Spoken English Classes in Chennai
Spoken English Class in Chennai
Spoken English in Chennai
Best Spoken English Class in Chennai
English Coaching Classes in Chennai

sathyaramesh said...

Selenium training in Chennai
Selenium Courses in Chennai
best ios training in chennai
Digital Marketing Training in Chennai
JAVA J2EE Training Institutes in Chennai
German Classes in Adyar
German Classes in Velachery
German Classes in Tambaram

Vicky Ram said...

Thanks for your contribution in sharing such a useful information. Waiting for your further updates.

Article submission sites
Education

Aruna Ram said...

Really it was an awesome article!!! It was so good to read and used to improve my knowledge as updated one, keep blogging.....
Data Science Course in Mogappair
Data Science Training in Annanagar
Data Science Training in Ambattur
Data Science Course in Tnagar
Data Science Training in Saidapet
Data Science Course in Vadapalani

Riya Raj said...

Wonderful blog!!! Thanks for your information… Waiting for your upcoming data.
Ethical Hacking Course in Coimbatore
Hacking Course in Coimbatore
Ethical Hacking Training in Coimbatore
Ethical Hacking Training Institute in Coimbatore
Ethical Hacking Training
Ethical Hacking Course

mercyroy said...

I really thank you for your innovative post.I have never read a creative ideas like your posts.here after i will follow your posts which is very much help for my career.
Selenium Training in Ashok Nagar
Selenium Training in Nungambakkam
Selenium Training in Kelambakkam
Selenium Training in Padur

Kayal said...

Great blog!!! It was very impressed to me. I like so much and keep sharing. Thank you.
Robotics Courses in Bangalore
Automation Courses in Bangalore
RPA Courses in Bangalore
Robotics Classes in Bangalore
Robotics Training in Bangalore
Automation Training in Bangalore

sathyaramesh said...


Pretty blog, so many ideas in a single site, thanks for the informative article, keep updating more article.
Best institute for Cloud computing in Chennai
Cloud computing Training Chennai
Cloud computing Training centers in Chennai
Salesforce Course in Chennai
Salesforce developer training in chennai
Salesforce Course

Kayal said...

It was very great idea!!! Your post is too good and very helpful for improve myself. Keep going....
Digital Marketing Classes near me
Digital Marketing Training in Chennai Velachery
Digital Marketing Course in Tnagar
Digital Marketing Training in Sholinganallur
Digital Marketing Training in Navalur
Digital Marketing Training in Omr

Gautam krish said...

Really great information!!! Thanks for your blog. Waiting for your upcoming posts.
German Classes in Coimbatore
German Language Course in Coimbatore
German language Classes in Coimbatore
German Language Course
German Courses in Coimbatore

Praylin S said...

Awesome post! Thanks for sharing. Regards.
Microsoft Dynamics CRM Training in Chennai | Microsoft Dynamics Training in Chennai | Microsoft Dynamics CRM Training | Microsoft Dynamics CRM Training institutes in Chennai | Microsoft Dynamics Training | Microsoft CRM Training | Microsoft Dynamics CRM Training Courses | CRM Training in Chennai

jefrin said...

Very impressive to read the post

Blockchain training in chennai

Ram Niwas said...
This comment has been removed by the author.
VenuBharath2010@gmail.com said...

You are an amazing writer. The content is extra-ordinary. Looking for such a masterpiece. Thanks for sharing.
IoT Training in Chennai
IoT courses in Chennai
IoT Courses
IoT Training in Porur
IoT Training in Adyar

jefrin said...

And indeed, I’m just always astounded concerning the remarkable things served by you. Some four facts on this page are undeniably the most effective I’ve had.
Data science Course Training in Chennai | No.1 Data Science Training in Chennai
RPA Course Training in Chennai | No.1 RPA Training in Chennai

VenuBharath2010@gmail.com said...

Great Post. Extra-ordinary work. Looking for your future blogs.
Informatica Training in Chennai
Informatica Training Center Chennai
Best Informatica Training Institute In Chennai
Best Informatica Training center In Chennai
Informatica institutes in Chennai
Informatica courses in Chennai
Informatica Training in Tambaram
Informatica Training in Adyar

janitha said...

Hello! I just wish to give an enormous thumbs up for the nice info you've got right here on this post. I will probably be coming back to your weblog for more soon!
big data course malaysia

qbcustomerhelp said...

Quickbooks enterprise support Phone number
Call the QuickBooks Enterprise phone number for 24 hours support for the Enterprise QuickBook. We are ready to solve QuickBooks Enterprise issues through the QuickBooks Enterprise Support Group. Please contact QuickBook Support Team (+1 (833) 400-1001) for help from a certified QuickBooks specialist.

qbcustomerhelp said...

Quickbooks enterprise support

Use QuickBooks Enterprise Support Team to fix QuickBooks Enterprise Issues. Please contact QuickBooks Support Team (+1 (833) 400-1001) for help from a certified QuickBooks specialist.

Ravya Khatoon said...

This is a very great post and the way you express your all post details that is too good. thanks for sharing- wpgroup , 9xMovie , TamilMV , Jio Rockers , movieswood , 9xRockers , Full Form .

Anonymous said...

Here at this site really the fastidious material collection so that everybody can enjoy a lot.

machine learning training

prince said...

Really it was an awesome article!!! It was so good to read and used to improve my knowledge as updated one, keep blogging...

clash of clans mod apk

Anonymous said...

Nice Post
For Blockchain training in Bangalore, Visit:
Blockchain training in Bangalore

Sri prathana said...

Nice Article

winter internship for ece students
electrical companies in hyderabad for internship
internship in indore for computer science students
free internship in chennai chennai, tamil nadu
free internship in chennai chennai, tamil nadu
internship for electrical engineering students in bangalore
internship in automobile industry
internship in chennai for mca
free ethical hacking course in chennai
paid internship in pune for computer engineering students

raju said...

first and best article...
dominican republic web hosting
iran hosting
palestinian territory web hosting
panama web hosting
syria hosting
services hosting
afghanistan shared web hosting
andorra web hosting
belarus web hosting

dras said...

wonderful post
denmark web hosting
inplant training in chennai

dras said...

good..
Australia hosting
Bermuda web hosting
Botswana hosting
mexico web hosting
moldova web hosting
albania web hosting
andorra hosting
armenia web hosting
australia web hosting

preethi minion said...

good one..
afghanistan hosting
angola hosting
afghanistan web hosting
bahrain web hosting
belize web hosting
india shared web hosting

Anand Shankar said...
This comment has been removed by the author.
kani said...

slovakia web hosting
timor lestes hosting
egypt hosting
egypt web hosting
ghana hosting
iceland hosting
italy shared web hosting
jamaica web hosting
kenya hosting
kuwait web hosting

shri said...

very nice...
internship report on python
free internship in chennai for ece students
free internship for bca
internship for computer science engineering students in india
internships in hyderabad for cse students 2018
electrical companies in hyderabad for internship
internships in chennai for cse students 2019
internships for ece students
inplant training in tcs chennai
internship at chennai

nivetha said...

gud nyc....
internships for cse students in bangalore
internship for cse students
industrial training for diploma eee students
internship in chennai for it students
kaashiv infotech in chennai
internship in trichy for ece
inplant training for ece
inplant training in coimbatore for ece
industrial training certificate format for electrical engineering students
internship certificate for mechanical engineering students

shri said...

good...
internship report on python
free internship in chennai for ece students
free internship for bca
internship for computer science engineering students in india
internships in hyderabad for cse students 2018
electrical companies in hyderabad for internship
internships in chennai for cse students 2019
internships for ece students
inplant training in tcs chennai
internship at chennai

Gbwhatapps said...

Thanks for sharing such valuable information I am also impressed by the creativity of the writer. This is excellent information. Thank you for sharing this valuable informative post about Digital Marketing Services. If you have any another information related Internet Marketing then kindly inform me. I am Sharing usefull imformation about Off Page SEO. It is amazing and wonderful to visit your site

Whatsapp group links

Anurag Srivastava said...

This is the first & best article to make me satisfied by presenting good content. I feel so happy and delighted. Thank you so much for this article... Post office Recruitment 2020 department is issued a new recruitment Notification 2020 For the Post of Postal Assistant and Postman Jobs...

sureshshetty said...

I found this informative and interesting blog so i think so its very useful and knowledge able.I would like to thank

7 tips to start a career in digital marketing

“Digital marketing is the marketing of product or service using digital technologies, mainly on the Internet, but also including mobile phones, display advertising, and any other digital medium”. This is the definition that you would get when you search for the term “Digital marketing” in google. Let’s give out a simpler explanation by saying, “the form of marketing, using the internet and technologies like phones, computer etc”.

we have offered to the advanced syllabus course digital marketing for available join now.

more details click the link now.

https://www.webdschool.com/digital-marketing-course-in-chennai.html

istiaq ahmed said...

We provide influencer marketing campaigns through our network professional African Bloggers, influencers & content creators.

Arunvijay said...

good post....
Coronavirus Update
Intern Ship In Chennai
Inplant Training In Chennai
Internship For CSE Students
Online Internships
Internship For MBA Students
ITO Internship

kidsenglishcollege said...

We develop free teaching aids for parents and educators to teach English to pre-school children. For more info please visit here: English for children

subha said...

Wow! this is Amazing! Do you know your hidden name meaning ? share more details,
Ai & Artificial Intelligence Course in Chennai
PHP Training in Chennai
Ethical Hacking Course in Chennai Blue Prism Training in Chennai
UiPath Training in Chennai

SAP Academy said...

Great Blog. Thnaks.
SAP Training in Chennai
Java Training in Chennai
Software Testing Training in Chennai
.Net Training in Chennai
Hardware and Networking Training in Chennai
AWS Training in Chennai
Azure Training in Chennai
Selenium Training in Chennai
QTP Training in Chennai
Android Training in Chennai

Anonymous said...


Thank you for sharing this very useful

Data science Training in bangalore
Aws Training In Bangalore
Hadoop Training In Bangalore
Devops Training In Bangalore
Iot Training in Bangalore

Ishu Sathya said...



A Great read for me, Well written technically on recent technology

Are you looking for Ethical hacking related job with unexpected Pay, then visit below link


Ethical Hacking Course in Chennai
Ethical Hacking Online Course
Ethical Hacking Course
Hacking Course
Hacking Course in Chennai
Ethical Hacking Training in Chennai
hacking course online
learn ethical hacking online
hacking classes online
best ethical hacking course online
best hacking course online
ethical hacking online training
certified ethical hacker course online

manisha said...

Many thanks for providing this information.
Data Science Training in Noida
Data Science Training institute in Noida

360DigiTMGMY said...


Your astounding wise data involves a lot to me and particularly to my friends. Much obliged a ton; from us all.
hrdf claimable

tejaswini said...

On the off chance that you are being mindful to gain proficiency with a few methodologies, at that point you should peruse this article, I am sure you'll get a lot of extra from this article.
360DigiTMG pmp certification in malaysia

360DigiTMG said...

"I can set up my original thought from this post. It gives all around data. A commitment of gratefulness is all together for this essential data for all,

"HRDF training

Unknown said...

you know, it is not working

360digitmg said...

I wanted to thank you for this great read!! I definitely enjoying every little bit of it I have you bookmarked to check out new stuff you post.

Best Institute for Data Science in Hyderabad

Unknown said...

Thanks for sharing this amazing blog

Bis Consultant in delhi

Anonymous said...

Thanks for Sharing This Article.It is very so much valuable content. I hope these Commenting lists will help to my website
top blockchain online training

Hemalatha said...

Thanks for sharing an informative blog keep rocking bring more details.I like the helpful info you provide in your articles. I’ll bookmark your weblog and check again here regularly.
Digital Marketing Course in Bangalore

Unknown said...

spa service gulshan

Mike Johnson said...

Frankly I don't understand why you lead this site blog when there are instagram and twitter. You can have more successful blog there. If you need to get first followers use this site https://viplikes.net to buy it

Madhan kumar said...

Hey, Wow all the posts are very informative for the people who visit this site. Good work! We also have a Website. Please feel free to visit our site. Thank you for sharing.
Be Your Own Boss! If you're looking for a change in your work prospects, then let's prepare for your career from here!!!
Self Employment | Women Development | Information Technology | Engineering Courses

Study Pharma said...

<a href="https://easysstudy.blogspot.com/2021/03/pharmacodynamics-by-kkc-easyshare-study.html/>Pharmacodynamic-General introduction</a>

Huongkv said...

Mua vé máy bay tại Aivivu, tham khảo

Vé máy bay đi Mỹ

đặt vé máy bay hà nội hồ chí minh

vé máy bay nha trang hà nội vietjet

sài gòn đi nha trang

vé máy bay huế đà lạt

xe taxi sân bay nội bài giá rẻ

combo khách sạn vinpearl nha trang

SEO Personal said...

Thanks for the information. Your content is the best on the internet so keep updating such informative content!
Satta King Result Chart for Today
Wedding Venue in Meerut
Digital Marketing Expert in Meerut
Top 10 CBSE Schools in Meerut
Website Designing Company East Delhi
SEO Company in Hapur
SEO Company in Meerut
Non Availability of Birth Certificate Meerut
Website development in Meerut


Vipul Singh said...

Your blog is very informative and you always update it in order to provide us such kind of knowledge, thanks for the help!
Kanag
Top Ranking School in Ghaziabad
Hearing loss treatment in Meerut
Online Marketing Company in Meerut

Mike Johnson said...

You can write about neural networks and machine learning on instagram. I think such topic will be popular today. From here https://vocal.media/lifehack/instagram-promotion-the-main-do-s-and-don-ts you can read how to get followers for your profile

Tec said...

Everything is your post going to be alright. Are we really being honest
Computer Full Form and Job Information
OTT Full Form

Rahul Saxena said...

Hi, your content is very unique and informative, Keep spreading this useful information. Meanwhile, Here on JustCol you can track down Memen.

Sawan said...

A great cryptocurrency to invest in is Score, where you will get a high return on investment. Invest in cryptocurrency today, don't delay.


Buy Cryptocurrency in UK Online


Cryptocurrency Risk Framework Company in India

Digital Marketing Agency Pakistan said...

Great post! Thanks for sharing. I like your content its unique and interesting, I have been always a fan of those who have this unique talent of writing unique content
digital marketing agency pakistan

Rahul Saxena said...

I like your content its unique and interesting, Best Private School in Bulandshahr I have been always a fan of those who have this unique talent of writing unique content . Best CBSE School in Bulandshahr

salome said...

Informative article with detailed explanation. Thanks for sharing your work . keep up the good work Angular training in Chennai

Rahul Saxena said...

Read the comments that have already been made an immense pwer, Best Properties in Gurgaon Exclusive Gurgaon properties for sale at limited edition. Best Real Estate Agent In Gurgaon

Huongkv said...

Liên hệ Aivivu, đặt vé máy bay tham khảo

vé máy bay đi Mỹ khứ hồi

bay về việt nam từ mỹ

đăng ký bay từ canada về Việt Nam

khi nào có chuyến bay từ nhật về việt nam

ve may bay tu han quoc ve viet nam

Vé máy bay từ Đài Loan về Việt Nam

khách sạn cách ly ở hà nội

Mike Johnson said...

I think you should make a video for tiktok about this machine. It is very interesting for people. You can get more followers for your tiktok profile from this site https://soclikes.com/buy-tiktok-followers

Tecclubs said...

Very good article I like this full Form website so please click

avalox said...

در تولید و چاپ تقویم رومیزی و فروش آن سایت های Vajegostar ، Digikala ، Bargcalendar ، Chapmatin جز بهترین ها هستند!

Ankit Rautela said...

You can attract the right customers to your company by making engaging content like infographics and marketing tutorials online. As soon as they register, you still have work to do by providing them with useful information on a regular basis and trying to close the deal.

Branding Services
Digital Marketing Agency

Reshma said...

This post is so interactive and informative.keep update more information...
Selenium Training in Bangalore
Selenium Training in Pune

CG said...

CapitalGrocery
Saffola Gold Pro Healthy Lifestyle Edible Oil (Pouch) (1 litre)
Saffola Gold Pro Healthy Lifestyle Edible Oil (Jar) (2 litre)
Saffola Active Pro Weight Watchers Edible Oil (Pouch) (1 litre)
Fortune Xpert Pro Sugar Conscious Edible Oil (Jar) (5 litre)
Fortune Xpert Pro Sugar Conscious Edible Oil (Pouch) (1 litre)

Anonymous said...

Best Digital Marketing Company in Meerut
Top Digital Marketing Company in Meerut

Matt Reeves said...

Great post. Thanks for sharing such a useful blog.
AWS Training in Anna Nagar
AWS Training in Chennai

Anonymous said...

You have amazing writing skills and you display them in every article. Keep it going!
Choose our Online Course Visit Cyber Security Bootcamp

Mark D said...

Excellent post!!!. The strategy you have posted on this technology helped me to get into the next level and had lot of information in it.
Meet And Greet Manchester Airport

Anonymous said...

Great Blog ! Thank you for sharing this useful information.
Adobe Commerce Solutions Partner in India

Tenzin Jamtsho- Digital Marketer said...

You have shared valuable content. Thank you for sharing such valuable content.
Digital marketing institute in Gwalior provides you the best digital marketing course for your digital growth.

Bharathi said...

Hi. The substance of the essay holds immense importance as well. When it comes to essays, it is essential to have informative content. Merely filling the pages with unnecessary words to meet the page requirement will result in a negative evaluation and substantial criticism.Here is sharing some AngularJS Training information may be its helpful to you.
AngularJS Training