今天关于输入法网上流行一篇文章，叫谷歌输入法，是个丑闻
1. 从技术角度说，词库不是一般意义的数据库。
为什么呢，词库的确是个数据库，但是这个数据库不是把网络上所有词
2. 数据和算法代码的不可分性
输入法这个例子很特殊，而且为了自定义词库扩充，技术上把算法
3. 中国网民相关知识的缺乏
由于中国的开放源代码运动不如国外，盗版软件使用非常多
提醒大家：sogou 输入法词库不是简单的数据库资料，作为软件部件一样受法律保护
Posts archived in Google
本文自由转载(CC 署名 非商业)。作者：美国华盛顿大学计算机科学系博士生Eric You XU, 研究方向是人工智能。
附：这是我第一次写文章拿出头衔，不是吓人，是为了避免人以为我拿技术忽悠人。我是有点不爽写这篇文章的，言辞上可能激烈了点，本文对事不对人。
每次谷歌出了什么问题，总有这样的句式出来：”这个这个问题嘛，技术上是这样这样的，你们不懂技术，来讲谷歌的坏话，不是Baidu的间谍就是XX的狗腿，要不就是愤青！ “。 比如说，上次出现中国翻译成不好的词事件，月光出来辟谣了，说这个么，是不好的词和中国的概率关联大了，所以翻译成不好的词了。 上次 方军竖中指，又有人说，这个么，就是按照搜索频率排序的，你们不懂技术和算法，所以不能怪谷歌。 这次 谷歌的输入法不幸和搜狗的一样而更不幸的是和自家搜索提示给的不一样的时候，晨钟暮鼓又出来辟谣了， 说这个么，很显然谷歌没抄，网民搜出的网络词库当然是是一样的阿。 好吧，你们总是用技术来说理，你们总是说，谷歌的技术是没有问题的，问题出在群众的智慧上，谁让群众都去搜黄色的，谁让群众都去搜搜狗开发人员名字的，谁让群众偏要把中国和不好的词联系起来的。一个个出来讲话的好像都是研究计算机方向的教授，元老，技术领袖。 网民就是被你们教训的，愤青就是被你的鄙视的，没文化就是被你们教育的。我在这里表明一下我强烈的不赞同态度。我认为， 澄清一件事情，不是用伪技术的谣言去驱赶另一个谣言，不是用大家都不懂其实自己也不懂的东西再次侮辱网民的智商。
我们说，技术不是一切，任何做技术的都要考虑到实际，经验非常重要，这就是为什么老程序员和新程序员写出的程序不一样，为什么人月神话讲优秀的程序员和一般人效率差十倍。我们首先要承认，谷歌的团队还很新，的确有考虑不到的地方，谷歌应当通过这些事情调整自己的团队，而不是把个人技术失误推到群众头上，这个是技术人员第一要务。 我在谷歌有几个好朋友，在Google总部也有，我问他们到底出现这些失误的时候怎么办，他们无一例外的都说是技术人员考虑不周, PM管理不严，我倒没看到他们把责任推到网民头上的。现在反而现在出来帮谷歌辟谣的人倒是技术领袖了，非要把技术上的事情推到用户上。 其实本来我想顺着说几句狂妄的话一一指出这些”懂技术的人”技术上的荒谬，不过我想想没王三表的文采就不要学老罗的骂街，况且理应对事不对人。我就想问，你们辟谣的各位高手中，懂机器翻译和自然语言处理的有几个，懂输入法的有几个，懂关键词提取和过滤的又有几个，包括前几天一个朋友和另一个朋友争论的时候（名字我隐去），一个人非要说趋势的算法是那样那样，不是这样这样，那么懂Google趋势是按照什么近似算法来提取日志的又有几个? 认真在技术上粉Google, 看过什么叫BigTable, 知道什么是MapReduce, 知道GFS, 会自己搭机群，了解数据挖掘，认真处理过中文语料，写过输入法，知道中文处理的大概内容的又有几个。别以为上过大学，看了TAOCP就是专家。当然，我自己也不是专家，我也不敢说我全懂，不过我一眼就知道有些人简直什么都不懂。
为了避免口水，也为了不偏重技术让这篇文章不可读，我不想一一指出这些错误了，我只希望我们学习计算机的和搞技术的，了解到这一点：”出了问题，就是技术人员和PM的责任，和用户无关“，拿用户说事的互联网，是Web 0.5, 是时代的倒退，就算在单机软件时代我也没有看到过这样推卸责任的。
我是一个忠实的Google 粉丝，我每天使用Google各项产品的次数多达百次，包括搜索，Gmail Reader Blogspot Talk Map Earth Code …, 我也有很多好朋友在Google/谷歌工作，我对Google的映印象一直非常好， 但是我不希望有人用伪技术或者假装懂技术为谷歌的技术失误辩护。 技术失误也是失误，考虑不周也是失误，不要往算法和”相信群众”上推，哪个年轻的团队没有失误呢, Google 一开始不也被SEO 和作弊严重困扰么。关键是认识到经验的不足，迅速修正，对广大网民做出交代，而不是啥事情都往技术上推，说技术领先，算法 自动产生，网民给的数据就是这样，不能怪谷歌。 啥叫技术领先呢，做出网民满意的结果才叫技术领先，技术领先，比的是最后的结果效率，不是一两句忽悠人的概念。还有，不懂技术的人少假装懂技术忽悠人，别 以为自己有多了不起，不知道一年才读了几本书看了几段代码。我这篇的主要目的就是提醒大家注意某些伪装懂技术的人，伪技术装起来比没技术更可怕。好比科学打假，这个不行那个不行，人家是伪科学你是真科学，妈的 自己到底懂多少科学? 当然我也怕你们用同样的话说我，所以我先退一步摆个姿态，我也一样，我也没读多少书，看多少论文，不过上面的几个领域，我都称得上中等研究水平，所以有底 气说这些。我写在这里，希望大家自由转载，是不想让互联网成为被谷歌 PR后的粉饰太平的文章堆或者不懂装懂人的炫耀场。
回到主题：澄清一件事情，不是用伪技术的谣言去驱赶另一个谣言，不是用大家都不懂其实自己也不懂的东西再次侮辱网民的智商。
附技术片段：
月光的话：
我推测这个错误可能是这么产生的，就是在Google的自动机器学习过程中，主要学习的是一些西方文献以及其翻译结果，由于西方对于中国的评价大多都是负 面的，因此某些”不好的字眼”经常和”中国”一道出现，当出现的频率很高的时候，Google就根据以往的常识，将这个”不好的字眼”和”中国”进行了一 定关联，于是就出现了这种智能推测。当然，这个技术问题解决起来也不难，就是扩大Google翻译的机器学习资料库，从不同的环境多分析一些资料（比如也分析一下人民日报的信息），这样推测词义出现的偏差可能会小一些，结果也会更为”中立”一些。然而令人不解的是，某些怀有不可告人动机的人不去研究技术和算法上的问题，而专门去找一些奇怪的缺陷错误，并将这种纯粹的技术问题上升到政治层面。
我的评语：月光同学可能不知道圣经语料库和Google联合国语料库这回事，月光同学了解基本的HMM模型，但是没了解语料库是怎么搜集的。的确要研究算法上的问题，不过不了解算法的人不能把问题全部推到算法上，这个肯定是技术失误而不是算法，退一步讲，如果算法出这个错，那就是模型有问题。
庄表伟的话：
我不知道这个方军什么来头，只怕是毫不懂法，及不懂算法，也不懂法律。更不要说美国的法律。
我的评语：算法根本不值钱，如果算法值钱的话，要这么多老程序员干什么。就算你懂算法，做了这个东西，难道没考虑过滤黄色内容不是失误么。这里的确是谷歌的技术失误，美国法律明文禁止暴露性内容，如果Google在美国没有做技术处理，老早就被抗议电话打爆了。
附晨钟暮鼓的话：
因为Google输入法与搜狗输入法都是充分的利用网络词汇作为词库，而取词都是来自于网络以及用户进行搜索的关键词，因此在词库上具有相似性是很正常的一件事。 再说词汇的注音错误的问题，其实这个更容易反驳。搜狗输入法也曾经有过这些错误的注音错误，只是现在人工改正了过来。这说明这些错误是因为通过网 络词库，网络取词而造成的，而同样的，Google输入法也是网络取词，因此出现同样的错误也是很正常的。错就错在Google对竞争对手的关注太少，没 有汲取对手的教训，而被对手抓住把柄。基于以上几点，关于Google输入法盗用搜狗输入法词库的问题无非是搜狗在面临强大对手时的无赖之举，而Google输入法不要被这些东西纠缠不清，踏踏实实地加紧开发进度，解决目前已发现的bug，因为你离我想象中的还差很多。
我的评语：相似的可以的，但是问题不是相似，是重合，除去你的那一个例子，其他搜狗开发人员在谷歌搜索提示中都没有，也没有正确结果。相反， 网络词库只会告诉你有这些词，频率是多少，而不是告诉你这个词读什么, 因为汉字的多音性，词的读音必须要手工标记，而实际上谷歌网络搜索建议的结果是正确，fenggong 等在Google搜索框中都是正确的结果， 为什么到输入法的时候词频就错了呢，如果采用网络词库，这不是前后矛盾么。 这个地方我怀疑作者并不不了解输入法的实现技术。
If you type <3 in Gmail talk (Note: Not the gtalk client or any jabber client), you will get a gif.
Take a look at this and this.
Well, no wonder! Love is really the thing needs <3 people :)
BTW, this is Google’s LOGO today:
Is it Google or Googe? Well, the romantic version is: g and l are falling in love. Or, you can not spell “girl” without g and l, they are together! (Chinese Version)
The XXX version is, they are 69ing. (Oh dude, I just cite the comments from Digg)
// BTW, The Internet is a series of tubes, not pipes. So enjoy YouTube and no bother Yahoo! Pipe. LOL!
Blogger Isaac Mao posted an open letter to Google Founders, which provided three suggestions. For me, I don’t quite agree with him, so here are my comments. I do believe that Dr. Kai-Fu Lee is the right person for Google China and the current strategy is right. (Come on, I have no relationship with him:) Well, probably in detail, Google China needs some improve/change, but the fundamental strategy is right. You can say no to me, please leave your comments freely.
Dear Larry and Sergey,
I’m writing you the short letter on behalf of many Internet users in China to have some suggestions to resolve the current dilemma for Google in China, from both business and social perspectives.
Google China now is not exactly in a dilemma. When we say dilemma, which means you can not go either way. However, we can see the progress in China. The marketing share decreasing in China is not necessarily the dilemma.
During the National Day holiday week in 2002, when Google.com was blocked in China for the first time, Chinese Google users made an online protest spontaneously. They appealed to free the purer search engine wave by wave. Its seemed its also the first time grassroots power was demonstrated in China on Internet. You can imagine how eager they are to have a complete Internet instead of a shrinked one. At last, people won, Google backed. However, after 4 years, we started to question whether we should continue to support Google. Many users here were disappointed when they found Google.cn filtered many keywords. The compromise remarks by you in Davos made us more frustrated. Seems you are adopting self-censorship which hurts those loyal users a lot which also devalue your motto of “non-evil”.
Here your basic assumption is that GFW is evil, and when Google filter the content himself, it is kind of evil. Let’s put it this way, if you can access google but usually get a connection reset, are you annoyed? Yes, we are professional user, we can bypass the sensitive keywords, we can setup proxy, we can do everything to fight with GFW. But the problem is, what should the common user do? The are expected to get a result, no matter sensitive or not, related to their search. However, sometimes, even their keywords are not sensitive, unfortunately, in the returning result, there is a sensitive content. Boo, they get a connection reset. Who can they blame? They are using Google, right? GFW will not say: “Sorry, your connection is reseted by GFW, please try later or dail XXX for more information”. To guarantee the user experiences, some compromises are needed here in China. I know nearly every blogger in China consider the GFW as evil. However, self-censorship is a down-to-earth strategy to make things work and protect Google itself in China. I think the Google’s philosophy is first make it work, then improve it. It is hard to say this is evil or not. For instance, if you can use Google but usually get the annoying connection reset everyday, what will you do? Will you choose Yahoo! or Baidu? Actually Google.cn is facing the small-business more than the blogger as the small-business will bring google the major income in China. Thus, to make the Google search work in China is much more important than other issues like the content. To assume every user has the technical knowledge and is patient enough to use Google behind the powerful GFW is gratuitous.
Google is ever regarded not only a leading Internet business, but a hope for many people around the world to open their thinking. Many bloggers in China still believes that in their everyday writings. We guess you were misled by incomplete information on how censorship is good to Chinese people. The fact is Google in the 130M-Internet-Users country is losing loyal users with loosing your principles. We understand its tough to anyone to make decisions. But it high time to change it back to the right track. Here we would like to propose 3 ideas to Google for its China strategy in a long term run, to survive, and live better:
The question is, who is the loyal users for Google now? Let me put it this way, do you really think that the Blogger in China will contribute more to Google China than the common user in terms of the income or searching market share? Do you really think the small business will not pay for Google only because Google self-censored the content without the overall quality of related AdWords?
1. Set up a 1B US$ corporate venture fund to invest in China’s Internet pioneer sites and cutting edge companies. The venture fund can be managed by experienced fund managers and industry gurus who really understand the value of Google, as well market potential of China. In my estimation, a venture fund with such a size can invest over 100 deals totally cover 60% of Internet traffic in China. With venture fund strategy, Google can play its manageable chaotic game in a capital way.
This idea is really bad. If Google really wants to setup up a VC, the best place for this fund is Silicon Valley instead of China now and in the near future. The main problem for Google China is the market share in the searching market instead of the whole Internet market. To invest the Internet company in China, which is actually invest the accessing point of Internet and the content producer or communities in China, Google will maintain a very long product line. The things is: you can not solve the dilemma in China in a capital way, Google China needs no money from the capital market. If this fund is for obtaining the market share or communities in China, the best way to manage this fund is Google China team themselves. We always emphasis the concentration of a company when they make the decision, which is also true in China. If Google want to play the game in a capital way, OK, please just suggest them to move the whole China technical team to Seattle or MV to develop other products or do the localization, and convert Google China to another Sequoia. VC can earn money, but is it really what Google China want? I don’t think so. The marketing share in search is quite hard to gain simply via investing. Google China now has 200- technical members and probably about 200 marketing/hr employees, which is rather a small team. You can image that for them, the localization is quite a heavy task, not to mention the product development for China market. Of course this small team can not take charge with the management of the fund. However, without their feedback, how can the VC choose companies to comply with the whole strategy of Google China. In one word, VC is good, but not helpful to solve the dilemma for Google China now if you say it is a dilemma. This strategy is in fact not a strategy. If this is a strategy for Google, it is also of Microsoft, for Oracle, for IBM, even for Citigroup, for American Express, for every Top 500 companies that wants to gain more money/market share in China.
2. Develop anti-censorship tools and service for global Internet users. In China as well some other coutries, censorship is still a tradition in culture. We are accustomed to control or to be controlled(It’s true!). But it’s too far from modern humanity and universal value. It won’t target China only, instead its a global issue to be solved. So it won’t cause Google’s operation in China into trouble. The budget to complete the mission will be not more than several millions dollars.
Good willing, but not easy to implement. I don’t know if you have heard about Tor. Tor is a tool to protect your content from GFW. However, to develop the product officically and distributed it openly is under a very high legal risk. For example, if we have this tool, can the gov-er-ment say: It is not legal to use this, as it is not legal to use a GPS speed camera detector? Of course the gov-er-ment can ban this tool like banning the speed camera detector, even these two things are inherently different (one is dangerous, one is for freedom). Actually, GFW is not the Google’s source of trouble in China. If the only issue is GFW, how can the smartest people at Google not come up with this idea? As you know, it is hard for google to obtain a permit to collect the news in China, that’s why Google News in China is called Google Information. It somehow reflect the key issue: the gov is the key constraint for Google China. However, how can Google blame/fight with the gov apparently in China if it wants to start the business? The only way to solve the dilemma is the combination of time and public relationship, which is in fact not a technical problem.
3. Increase the incentive to Chinese Google Adsense users. This can dramatically encourage more Internet users to participate Google’s business ecosystem. It’s a pure business strategy to increase loyalty as same important to Google’s products in China. Anyway the tactic should be deployed with better localized customer service to respect to individual users and protect their less to hundred-dollar income.
True, but unachievable. It is in fact the unfair competition and will essentially impair the whole searching market in China, which is also not good for Google.
Google is not alone. There are still several millions Google fans in China, especially those bloggers who are more real time intelligent to outside world. If Google do good as they did in early days. There will be more supporters for sure. Google is not playing a game of itself. You may under-estimate that before with limited information sources. People here are looking forward that you can pick the three suggestions(or partly) as China strategy in the coming years which can keep Google’s “non-evil” motto alive in people’s mind. It will also benefit to Google’s business in China. It will be also benefit to the whole Internet neutrality in China. All the Internet users will appreciate that eventually.
True. I am also a GFan. Support is not everything in China, right? We have supported someone in the history, but the result was not tah as we expected. If Google’s opponent in the game is baidu, support is everything. If the opponent is gov which you want Google to be the other player, it is a fatal game and usually no winner, support is nothing.
All of all, the pure the better; the more compromise, the worse.
You bet, but it is a further goal. Now, let’s face the truth: In China, more people choose Baidu while Baidu does the self-censorship ever since the very beginning. Why Baidu success, because of the pure? Well, I am not going to say: be evil. The key is: know the real situation in China, understand the local policy and have the good relationship with the gov. Sounds evil, but it is true. And I can see the progress, I think Google will be out of this trap soon.
[Translated From Ask Blog and Googleblogoscoped] (快速翻译一篇文章，仅做调侃搞笑用)
Google牌笔坏了 [原文]
Ask.com (美国一个搜索引擎公司) 的Blog上又贴出了一个Google 的产品最近出现了小问题一个帖子。这次的问题产品叫做”Google圆珠笔” 这里还有一个 Google迷宫游戏坏掉的视频。
下面是Ask.com的帖子的翻译
Google 最近的一次当机
世界上有些事情就是巧啊，才读了 Nick Gonzalez’s 在 Techcrunch 上的一篇 Google 又当掉 的文章，又一个Google产品让我们当了一下，这次是；
2007年2月2日: Google 圆珠笔没油了.
Scott Grieder, 是Ask.com 团队的产品经理。他在一个很重要的电话会议中用Google 圆珠笔做纪录，不幸的事情发生了，那支圆珠笔居然没油了。这个Google基础产品／服务的失误使得他在重要时刻不得不换一支笔，并且造成了显然的不便以及数据的丢失。
在最近一次见面中，Scott和我们说，”我应该更多了解一点Google产品用于商业用途的(利弊)，Google 圆珠笔适合家用，但是当考虑到我们公司的生产率时，（他就不一定适用了） 我不得不在纪录过程中换了一支笔。而且我也不知道我丢失了多少数据。
下面是Google圆珠笔的生产效率图
这个笔的笔体和笔芯都是透明的，用户可以看到笔中间并且大致预测什么时候没油了。但是因为可能有些杂质，圆珠笔油把笔体弄脏了，所以给用户一个笔还有足够多油的错误印象。
“现在我用其他的笔办公了（或者，我现在申请其他笔的服务了）”，Grieder说，”唉，我一直相信Google一直支撑着他的产品，现在看来我错了”
Google圆珠笔，谢谢你，你起到了你应有的作用。
－－Ask团队
更新1：他又可以写了。好像里面还有油的。谢谢Matt Cutts 的建议”写前用力摇一摇”
更新2：又不能写啦
[Ask 也是够绝的，拉着这个发挥:)]
作者介绍：Tinyfool 郝培强, 活跃于CSDN的著名程序员，也是知名的Blogger，Web2.0观察者和 Google Fans, 他在网上留下的足迹包括 Donews, CSDN ，微尘程序员网，和 ZMap全能之眼。难能可贵的是在繁忙的工作之余，Tinyfool 向社区贡献了Google Maps API中文同步文档， 他同时也是Wikipedia 的见习编辑. 我从大学二年级就开始关注他并在最近利用 Orkut和他结识。 在闲暇时间，他喜欢 音乐、篮球和看书， 你可以访问他的 个人主页或者通过 tinyfool[A@T]gmail.com 联系他。
谷歌的失败正好证明Google的成功
–原发 TV的Google观察Blog 原文链接
在偏执狂才能生存的世界，放弃偏执放弃理想，就放弃了你与众不同的那一点，也就失去了存在的价值。
谷歌这个名字
谷歌这个名字的诞生，就意味着自信的Google文化并没有跟李开复先生一起抵达中国。谁规定说在中国的产品就必须有一个中文名字？IBM的中文名字是什么？国际商用机器公司，有几个人知道？
退 一万步说，如果中文名字是真的必须的，那么你在地址栏是不是还要输英文字母。谷歌这个名字诞生了这么久，开复先生能不能给我一个统计数字，告诉我中国的用 户更喜欢输入guge.cn和guge.com着两个域名呢？如果，他们真的喜欢这两个名字，那为什么还要把这两个地址转向到google.com或者 google.cn上去？
Google.cn这个域名
除了IT圈子的老鸟，我想知道，有多少人知道Google.cn这个域名，有多少人知道它和Google.com的区别。Google.cn的搜索结果和伟大的Baidu.com一样纯洁，绝对不会引起屏蔽。但是为什么大家抛弃Google投到Baidu门下， 首要的理由都是无法访问呢？
Google黑板报写了这么多篇了，有一篇告诉用户如果你的Google.com访问不了的时候，你可以用Google.cn来代替么？
当GFans都承认在全中文的搜索情况下，Google的结果确实可能比Baidu更差（虽然没有出售的排名带来的不公平，但更多的SEO，更多排名本地化问题）。 Google.cn除了去掉一些可以导致危险的结果以外， 还做了什么？
Power By MapABC的ditu.google.cn
对 这个产品，我不想多说，只能说新版虽然样子跟maps.google.com越来越接近，但是它彻头彻尾是一个OEM产品，技术和数据都不来自 Google或谷歌。数据很好理解，由于政策因素，购买或者租用国内地理信息服务公司的数据顺理成章。但是技术就完全说不过去了， Maps.Google.com是目前同类产品中最好的（Yahoo和微软还在追赶）。有人可能觉得我太技术倾向了，但是我最关心的其实是用户体验， ditu.google.cn中的分词，地址查找等等都垃圾得一塌糊涂。
在国内有go2map和百度地图这样的对手前提下，OEM这么一个产品，对市场分额没好处，用户满意度没好处，唯一的好处是，你看，我们谷歌也在努力工作呢，但是唯一的结果是给 谷歌其实不懂中文这一论点提供了论据。
谷歌不是Google
这段时间，谷歌努力地向我们证明，一个公司的基因，不是它的资本构成，不是它漂亮的办公大楼，不是员工的双屏电脑（我倒宁愿是，现在我也是双屏了，我比他们还强，我有一台PC和一台MacBook一起用。So酷， http://www.flickr.com/photos/chinapodcast/319506132/)，不是随便取用的饮料和食品，不是高薪的大厨，不是20％的创新时间，甚至不是公司总部任命的全球副总裁。
所以，在Google全球业务蒸蒸日上的时候，我们迎来了一个 新的年度搜索报告，
在以新标准公布的数据中，谷歌（Google）的网页搜索市场份额首次跌破20%，仅为14.9%，而根据稍早前CNNIC和正望咨询从其他角度分析的数据，谷歌2006年在中国搜索引擎市场上的份额分别为25.3%和20.6%，都不同程度表明了其市场份额萎缩的趋势。
如果这个报告准确的话，那么Google通过建立一个叫做谷歌的公司来退出中国市场的伟大计划，又得到了进一步的成果。
如果对比，谷歌进入之前的市场份额，那么我的题目就不算离谱了”谷歌的失败正好证明Google的成功”。