Monday, September 21, 2009

Netflix Prize: $1 Million Paid, Another Million Now Up For Grabs

After nearly three years and efforts by more than 51,000 people worldwide, Netflix today awarded the Netflix Prize and $1 million to a team of seven engineers, statisticians and researchers from Austria, Canada, Israel and the U.S.

The team "BellKor's Pragmatic Chaos" leaderboard met face-to-face for the first time this morning before a news conference at which Netflix CEO Reed Hastings and Chief Product Officer Neil Hunt named them winners, draped Olympic-size "gold" medals around their necks and handed them a check for $1 million. Their collaborative entry had taken place entirely over the net.

Moments later Neil announced details about Netflix Prize 2.

The contest ended in July with moments of real drama. Engineers at Netflix watched in amazement as the contest came down to the last few minutes when the winning team just edged out "The Ensemble," many of whose members were present at the New York award ceremony.

Netflix Prizemasters Stan Lanning and Jon Sanders have been extremely pleased how participants openly offered advice, information, ideas, and even libraries of code on the Prize Forum pages. The final result is a benefit to Netflix members as the movie predictions we make for you will be twice as good as before.

While the final curtain has come down on the Prize, Neil lifted the curtain a bit on the upcoming new Netflix Prize 2 contest. It will focus more on helping customers early in their experience with Netflix, drawing on many more sources of data to try to find just the right movies.

For more information on the winning entry for the original Prize and the new Netflix Prize 2 contest check out http://www.netflixprize.com.

90 comments:

Anonymous said...

Fantastic, now netflix can know what movies I will like.

How about inventing some magical electronic method of contact so I can report a customer service issue without using a telephone.

Hi netflix, the year 1984 called, cause you didn't allow them to use their new fangled email thingy, and were wondering when you were going to join the 21st century & allow customers to email you.

Anonymous said...

Silverlight streaming had become really decent quality. Now it has dropped back to being horrid no matter what I do. Also, I used to be able to reset the calibration by clicking on the video quality measurement indicator. Now that seems to have vanished and with it my only way of improving my video stream. I'm really disappointed.

Anonymous said...

Look What I found...

http://www.netflix.com/Suggest?type=2&lnkctr=cu_suggest


Contact Us
Requests and Suggestions

I'm guessing they buried this as soon as they switched over to Silverlight. As if they want to hear what the paying customers think. I'm not sure if anyone still gets these, but you can try.

Anonymous said...

Hopefully the next million dollar prize will go to whoever figures out how to fix to the tearing issues caused by Silverlight.

Apparently it's too much for the mighty Microsoft.

Anne said...

The Netflix Prize 2 is a bad idea. Here's why:

http://www.freedom-to-tinker.com/blog/paul/netflixs-impending-still-avoidable-multi-million-dollar-privacy-blunder

Sean Rea said...
This post has been removed by the author.
Sean said...

Seconding the notion that releasing volumes of customer data is a bad idea. Netflix ought to have an opt-in policy regarding the inclusion of customer data in this contest.

Anonymous said...

You forget, opting in or out of anything Netflix wants isn't an option. Just ask anyone sucked into Silverlight when it was still an "upgrade" option.

The only way to opt out is to cancel Netflix.

Rob said...

Wow, I was considering signing up for Netflix, but your website makes me reconsider.

I can't find anything other than a free trial, and as we all know free trial (esp on the internet) equals scam.

The only documentation I can find for the pricing structure is on the gift cards page.

The contact us page gives no options for non-members that have questions.

In short marketing overload-website fail. I'll try again in a few months maybe you will have made a helpful site by then.

Anonymous said...

Congrats to Pragmatic Chaos! This contest was a complete succuss for the research community, which benefits all of us. http://www.nytimes.com/2009/09/22/technology/internet/22netflix.html?_r=1&scp=2&sq=netflix&st=cse

C0LdBust said...

I think Netflix is doing a great thing, inspiring innovation (and buying the best ideas for a cheap price).

That being said, I also believe that this new contest would lead to an invasive algorithm. Let's say TWC or DISH does the same. Would my DVR automatically record things that I never want to see (like the infomercials it currently does), or would I have to buy an updated DVR with a bigger hard drive to compensate for the "new features"? Would I need increase my account limitations, or just waste an hour watching a "C-" movie that was recommended? A.I. algorithms should not count for everything....

Well, I guess "That's just BUSINESS"

Anonymous said...

PROTECT MY PRIVACY!!



Netflix yesterday passed out a $1 million check to the stats geeks of "BellKor's Pragmatic Chaos," the team which won the Netflix Prize by improving on the company's algorithms for picking the movies that Netflix subscribers might like to watch next. Chief Product Officer Neil Hunt then announced a sequel, the Netflix Prize 2, but one law professor is already calling the new contest a "multi-million dollar privacy blunder."

The Netflix data set released for use with the first prize was supposedly "anonymized," but security researchers found a way to link the anonymous movie recommendations with data from other sites in order to identify individual Netflix users. If your information appeared in the first data set, someone knowing a bit about your movie preferences could figure out the complete set of movies that you rated on Netflix—an information leak that would certainly not please all users.

For the Netflix Prize 2, the company is releasing even more information, despite the security weaknesses of the first data set. Gender, ZIP Codes, ages, genre ratings, and more will be released in a data set with more than 100 million entries. That has law professor Paul Ohm seeing a bright Netflix red.

Ohm has worried for years about privacy breaches, and his newest paper argues that "anonymizing" data doesn't actually keep data anonymous. Given the tremendous advances in "reidentification" technology over the last few years, Ohm argues that the release of so much new data should actually constitute a "privacy breach."

"Researchers have known for more than a decade that gender plus ZIP code plus birthdate uniquely identifies a significant percentage of Americans," he wrote in a blog entry. "True, Netflix plans to release age not birthdate, but simple arithmetic shows that for many people in the country, gender plus ZIP code plus age will narrow their private movie preferences down to at most a few hundred people. Netflix needs to understand the concept of 'information entropy': even if it is not revealing information tied to a single person, it is revealing information tied to so few that we should consider this a privacy breach."

Because Netflix already knows about the privacy implications of its data releases, it can't simply claim ignorance, and in Ohm's view the company might well be liable for damages.

"The Video Privacy Protection Act (VPPA), 18 USC 2710 prohibits a 'video tape service provider' (a broadly defined term) from revealing 'personally identifiable information' about its customers. Aggrieved customers can sue providers under the VPPA and courts can order 'not less than $2,500' in damages for each violation. If somebody brings a class action lawsuit under this statute, Netflix might face millions of dollars in damages."

Netflix claims, "As with the first Netflix Prize, all data provided is anonymous and cannot be associated with a specific Netflix member." It's an odd thing to say, as the first data set was already de-anonymized, but the company is going ahead with it. This time, the "Netflix Prize 2 focuses on the much harder problem of predicting movie enjoyment by members who don't rate movies often, or at all, by taking advantage of demographic and behavioral data carrying implicit signals about the individuals' taste profiles."

Rather than wait for years before awarding a prize this time around, Netflix has decided to give $500,000 to the team in front after six months, and another $500,000 to whichever team is in the lead after a year and a half.

Anonymous said...

I am a Netflix subscriber. I'm even one who rarely turns over movies but pays monthly anyway. I should be the kind of subscriber you really, really want to retain. But I can get movies from my local library without worrying that my viewing data (even "anonymized" which researchers have shown isn't) is being released to the public to play with. You may be violating laws on video rental privacy, and you are certainly violating my understanding of customer relationships. Please DO NOT GO FORWARD with the "Netflix Prize 2"

Anonymous said...

I have been a netflix customer for years, but this announcement is making me reconsider. PLEASE think before releasing all your customer's personal data to the world - data mining just keeps getting better - and the "anonymization" you did to the last data set for the first prize was PROVEN to be inadequate to keep our records private. THINK.

Jon said...

I understand that this new Million Dollar contest is intended to improve suggesting movies to those who do not rate movies. Let me save you some money.

I am a very happy Netflix customer who never rates movies. But I would start rating them a whole lot more if Netflix would change the website so that “My Rating” would NOT cover up the “Member Average.” I want to still see how other people have rated this movie IN ADDITION TO how I’ve rated it.

They could make 2 rows of smaller stars in order to do this, or they could simply show my “Number” to the right side of the current stars that would continue to show the Member Average. It’s that simple. Thanks.

Send me 20 Bucks and we’ll call it even. LOL

Anonymous said...

Mamadeira.

freefun0616 said...

酒店經紀人,
菲梵酒店經紀,
酒店經紀,
禮服酒店上班,
酒店小姐兼職,
便服酒店經紀,
酒店打工經紀,
制服酒店工作,
專業酒店經紀,
合法酒店經紀,
酒店暑假打工,
酒店寒假打工,
酒店經紀人,
菲梵酒店經紀,
酒店經紀,
禮服酒店上班,
酒店經紀人,
菲梵酒店經紀,
酒店經紀,
禮服酒店上班,
酒店小姐兼職,
便服酒店工作,
酒店打工經紀,
制服酒店經紀,
專業酒店經紀,
合法酒店經紀,
酒店暑假打工,
酒店寒假打工,
酒店經紀人,
菲梵酒店經紀,
酒店經紀,
禮服酒店上班,
酒店小姐兼職,
便服酒店工作,
酒店打工經紀,
制服酒店經紀,
酒店經紀,

,

john said...

How do you get to search the new releases on the site? It seems that most of the movies that show up are so old that they already playing on HBO by the time they show up in the new release section?

What are the tricks to find the netflix "hidden" new releases?

Thank you!

Anonymous said...

Rather than paying out $1 million to improve your movie recommendation system, why doesn't Netflix invest in better quality control? Yet again I am having to return a DVD that kept reverting to the beginning halfway through (and yes, I cleaned the disc properly). This happens far too often, making Netflix much less of a value alternative to my local rental store. ALSO, the first commentator in this string is absolutely right -- why can't we e-mail Netflix instead of hoping you'll read comments on the blog? (Telephone complaints mean little, I'm sure.)

Anonymous said...

We love Netflix, especially the Instant Watch option... took us a little while to catch on. :-) It works great on all our laptops over a cheap DSL connection. One thing I'd like to see is a dropdown list to select different profiles under a single account. As it is, our preferred picks are a mashup of sappy love stories and sci-fi/documentaries and the result is not pretty. :-) It would be great if, when you go to the page, you could select an identity and just see your own stuff if you want to. I sent in a suggestion to Netflix. Let's see what happens.

Anonymous said...

Osso da cabeça, esmagado de caminhão 220 kilômetros por hora.

Anonymous said...

On the topic of ratings, a suggestion for TV series - let us make a rating on the series as a whole, and not just individual seasons.

Thanks!

DansMuayThaiMMA said...

I am digging this. Anything that gives us a chance for some winnings is a good thing. Great job Netflix.

Anonymous said...

Nasa, Discovery, chinelo preto, Caloi Cross, BMX.

Anonymous said...

Maybe Netflix can just hire a cryptologist who can find movies we might like by looking for patterns in our credit card numbers.

I say if people don't rate movies than that's their choice, and Netflix should leave well enough alone.

Tech said...

$1 million is quite a bit of prize money.

Anonymous said...

Aldebara, Cruzeiro do Sul, Hoje esperei até de manhã, brilho de estrela caindo bem devagar.

Anonymous said...

I had been a subscriber but may never be again. DO NOT LIKE
the pop ups . My pop up blocker doesn't block you

Aaron said...

"How about inventing some magical electronic method of contact so I can report a customer service issue without using a telephone." and the rest, agreed

You all should be awarded for your mastery of customer evasion. Go ahead, give yourself a million.

I have been a member for several years, despite what it says under "My Account" (WTH, BTW?) and you have always been horrible at making yourselves available to your customers. It sucks.

As this is the only place I have found to leave a comment I leave this question? Why the hell does the queue have no bearing on what is actually delivered? I put my DVDs in the mailbox on the way to work, on a break I log in and reorder my Queue (doubtful my mailman has even been to my house to pick up the DVDs yet.), yet somehow I end up receiving the DVDs as if I had never reordered.

Didn't used to be this way. This, too, sucks. Explain, please.

PC Tech said...

I don't think that streaming video quality will be ever the same or similar as the dvd quality.

Web Diva said...

Netflix annoying email verification. I am tired to "remind me later" with a valid email address. Just because I choose NOT to read netflix emails doesn't mean it is not a valid email.

I am annoyed.

How do you fix this?

Anonymous said...

They could improve the suggestions simply by allowing more nuanced ratings. I like to use the ratings to remind myself what I thought of movies I've seen, but I wish I could do it in higher res. than just 1-5 stars. I'd like the option of assigning a decimal number like you see in the customer ratings and the netflix estimates.

Anonymous said...

I think it's great that Silverlight, Microsoft's pride and joy, works best using Firefox on a Mac.

Anonymous said...

I got the 2 week free trial. Canceled on the last day and was still charged $15 to my card. I tried to find a way to email Customer Service and was VERY disappointing to find there was no email option for Customer Service. I was planning on rejoining Netflix in a couple of months (I really don't have time right now to watch movies, but will in a couple months when things settle down), but between them charging my account and me not being able to contact them unless I find time to call, wait on hold, be transferred, etc. I guarantee that I will not be rejoining Netflix ever. I'll try out Blockbuster & hope I have a better expereince. I can not believe that a web based company does not have email for us to contact them. Yet, they want our email and can contact us that way. Maybe they should start calling all their customers whenever things are shipped instead of emailing. Crazy!

Anonymous said...

why can I watch tv instantly on hulu.com on my older laptop but netflix instant view won't play on my laptop? I can't find where to email netflix directly

Anonymous said...

Oque foi a balaiada?
Oque foi a sabinada?

Anonymous said...

成長ホルモン分泌促進

子育て安心食材配達oisix

有馬温泉貸切露天風呂

つかってみたらよかせっけん

子供の低身長成長ホルモン

ふぞろい野菜ならオイシックス

Anonymous said...

Fuzilado, com 1000 tiros.

Anonymous said...

Netflix is officially DOWN!

Anonymous said...

I'm a 5-at-a-time customer and really annoyed.

Instead of "awarding another million" to unknowns, why not have a SUGGESTION box?

I hate not having customer service or MOVIE SUGGESTIONS.

I'm thinking about going to Blockbuster.

Anonymous said...

Car, Alecrim.

eda said...

潤滑液,SM,內衣,性感內衣,自慰器,充氣娃娃,AV,
情趣,G點,性感丁字褲,情趣,角色扮演服,吊帶襪,丁字褲,情趣用品,無線跳蛋,男女,

色情小說|

情趣按摩棒,自慰套,角色扮演,按摩棒,跳蛋,情趣跳蛋,
.,
按摩棒,電動按摩棒,飛機杯,視訊,自慰套,自慰套,情趣用品,情趣內衣,

Anonymous said...

Bronzeador.

Anonymous said...

I posted this link to Netflix's old Requests and Suggestions...

http://www.netflix.com/Suggest?type=2&lnkctr=cu_suggest

Just for the hell of it I was going to send them a idea that they should movies from the "Save" list to the top of the queue, so you know that they are there.

Anyway, they killed the link. I guess people were trying to contact them and they don't want to hear it.

Netflix, you cocksucking motherfucking cuntwhore doucebage motherfucker. I fucking hate you.

Anonymous said...

Netflix should just get it over with and send everyone a single e-mail.

"Dear paying customer,

FUCK OFF

Thank you,

Netflix"

Anonymous said...

Aperta a cabeça com um parafuso grande, com uma chave grande, amarra no eicho, com uma corda pra direita para, depois pra esquerda, esmagado na cabeça.

Anonymous said...

I hope someone at Netflix actually reads this because I have two issues I don't feel like wasting my time sitting on hold with them over.

1) Seriously? A entirely web based company without any email customer support? I appreciate the solid telephone support service, but come on, like I want my boss to see me on the phone with you while I'm at work. Just let us email in. I'm only interacting with your brand via the internet anyway.

2) What happened to my ability to request a title? Netflix, one of your major attractions in your catalogue of obscure titles. Not allowing me to request one makes me feel like you're slipping in that department. It also makes me feel like you don't care what I think. There's stuff out there I want to see that you don't have. Now I'll have to look elsewhere for it. If this happens a lot, why should I remain a customer of yours?

Sorry for the post that's irrelevant to the topic, but Netflix hasn't given me any other forum to express my concerns.

Anonymous said...

This was the link they used to have.

Requests and Suggestions

http://www.netflix.com/Suggest?type=2&lnkctr=cu_suggest

Once they started using Silverlight, they took it off their website (I guess they got sick of hearing paying customers complaining about how shitty streaming was because of Silverlight). Someone found the link and posted it here. Within 2 weeks, Netflix killed it.

Get it through your heads people. Netflix doesn't give a rats ass about it's customers anymore. We mattered when they were just starting up, but now that Reed Hastings is on the Microsoft board of directors, do you really think he, or his company, gives a shit about you?

Anonymous said...

Bimotor, eo eo eo.

Anonymous said...

Derramate.

Anonymous said...

Pinwheel galaxy, 10 mil sabonetres.

Anonymous said...

Caminhão, da lenha.

Anonymous said...

Horas 8, ultrapassou a barreira do som.

Anonymous said...

M16 pillars, 1950.

film izle said...

Hopefully the next million dollar prize will go to whoever figures out how to fix to the tearing issues caused by Silverlight.

Apparently it's too much for the mighty Microsoft.

filmler said...

film izle

film seyret

film izle

film izle

çizgi film izle

sinema izle

anime izle

erotik film izle

sinema izle

Anonymous said...

When is your prize going to come up for someone to port online streaming to the ps3? If its not by the end of the year, I quit.

Anonymous said...

Er han med i ``danmark´´?
Eller er han fuld af
darlige undskyldninger?
-klik her og se

chimala said...

I'm a new customer. I eagerly rated 567 movies. Still it has zero recommendations! And it says "Rate more movies so we can help you find movies you'll love.". Really?

How many do I have to rate before it starts working?

Sashi

Anonymous said...

Terremoto, aflochou a roda.

Anonymous said...

Hello, great post, I fully agreed with author and recent commenter.

acai berry

Anonymous said...

Confirma, galaxia.

Anonymous said...

Caça, C130 Hercules.

chad said...

windows 7.....................WHEN WILL WE BE ABLE TO WATCH NETFLIX IN W.M.C. FOR WINDOWS7?!!!!

filim izle said...

Thank you film izle
bedava film izle
divx film izle

Frank said...

the whole "movies you will love" tab has always been a bust. i have rated over 4,000 movies and never get a recommendation. The reason is because I hardly ever give movies a 5 star rating. Lets not forget that 3 stars is "liked" and 4 stars is "really liked". It's OK to suggest movies that might not be a 5 star movie. The whole system needs to loosen up a bit because right now rating movies that you like or really like does nothing at all for recommendations.

Anonymous said...

Sorry folks, not excited at all. I'm a human being, not a machine. You'll never be able to "predict" what movies I'll like. Never.

Anonymous said...

I really don't care much at all for the movie recommendations. Unless, of course, I opt to request said recommendation. Most of the time, I check daily to see all the latest releases, especially the watch instantly releases. I just want to see exactly what has been released in the order it was released. I try not to rate anything at all, just to maintain this capability. Still I see brand new releases buried several pages into the lists despite my efforts. Smart recommendations are great, but chances are great that I have seen all the recommendations. Please, whatever algorithm is developed or used in any area, allow us to bypass it for a clean, unmodified listing of our choice.

Michael Bannen said...

Someone should LOSE a prize for changing the way ratings are displayed. I used to get member ratings AND best guess for me. Now I just get best guess. Guess what? The guess is often wrong. Taking away the ability to see member ratings when mousing over a movie means I will view fewer movies...not at least giving users the option of turning that "feature" on or off was a bad usability move.

Anonymous said...

NETnudity,NETFLIX & naughty NETFLIX,NETFLIX trash FLIX

Anonymous said...

HOW many posts can one post

Anonymous said...

HOW many posts can one post

Anonymous said...

HOW many posts can one post

Anonymous said...

HOW many posts can one post

Anonymous said...

HOW many posts can one post

Anonymous said...

HOW many posts can one post

Anonymous said...

HOW many posts can one post

Anonymous said...

HOW many posts can one post

Anonymous said...

HOW many posts can one post

Anonymous said...

HOW many posts can one post

Anonymous said...

HOW many posts can one post

Anonymous said...

UK CD view like2fcuk88 ( video )

Anonymous said...

YouTube as blackle4PS3 & 2sillytube

Anonymous said...

clubzone (tickets) - global night clubs & free gallery to build maybe view blackle4ps3 gallery , WHO IS blackle4ps3

Anonymous said...

HOW many posts can one post

Anonymous said...

Why does netflix suppress any recent DVD release from appearing in the results of new release searches? It appears that most of the release have are already playing on likes of HBO. Why do they do this?

reisbey said...

film izle
direk film izle
film indir
film seyret
direk izle
sinema izle
online film izle
bedava film izle
filim izle
direkizle
indirmeden izle
el terlemesi
kelebek

call of duty said...

I think netflix star system is great!

Anonymous said...

I value the ratings that other Netflix subscribers provide for movies. I am extremely disappointed that it now appears that Netflix only intends to provide a computer generated rating where the computer guesses what "rating" I would give a program. I rarely agree with these ratings.

I would like to see a return to the old system where both ratings are provided. In addition, I would like to have the option totally eliminate the computer rating and only view the average rating of other subscribers. I am almost disappointed enough to join Blockbuster and might do so when and if they provide Internet download capabililty to my TV.

Anonymous said...

After reading through some of these comments, I completely understand why Netflix does not have email support. I wouldn't want to read a million emails from idiots either. I don't think Netflix really cares if pain in the ass customers move to Blockbuster, threaten all you want. They will probably say good riddance. I would. Do you really think your 9 dollar subscriptions carry leverage? Get real.