《镜子大全》《朝华午拾》分享 http://blog.sciencenet.cn/u/liwei999 曾任红小兵,插队修地球,1991年去国离乡,不知行止。

博文

Is Google SyntaxNet Really the World’s Most Accurate Parser

已有 4443 次阅读 2016-7-23 22:40 |个人分类:立委科普|系统分类:科研笔记| google, parsing, syntaxnet, quality

No way!

Google is a giant and its marketing is more than powerful.  While the whole world was stunned at their exciting claim in Natural Language Parsing and Understanding, while we respect Google research and congratulate their breakthrough in statistical parsing space, we have to point out that their claim in their recently released blog that SyntaxNet is the "world’s most accurate parser" is simply not true.  In fact, far from truth.

The point is that they have totally ignored the other school of NLU, which is based on linguistic rules, as if it were non-existent.  While it is true that for various reasons, the other school is hardly presented any more in academia today due to the  mainstream’s dominance by machine learning (which is unhealthy but admittedly a reality, see Church’s long article for a historical background of this inbalance in AI and NLU:  K. Church: “A Pendulum Swung Too Far”), any serious researcher knows that it has never vanished from the world, and it actually has been well developed in industry’s real life applications for many years, including ours.

In the same blog, Google mentioned that Parsey McParseface is the most accurate such model in the world,  with model referring to “powerful machine learning algorithms”.  This statement seems to be true based on their cited literature review, but the equating this to the “world’s most accurate parser” publicized in the same blog news and almost instantly disseminated all over the media and Internet is simply irresponsible, and misleading at the very least.

In the next blog of mine, I will present an apples-to-apples comparison of Google’s SyntaxNet with the NetBase deep parser to prove and illustrate the misleading nature of Google’s recent announcement.

Stay tuned.


[Related]


Announcing SyntaxNet: The World’s Most Accurate Parser Goes Open

K. Church: "A Pendulum Swung Too Far", Linguistics issues in Language Technology, 2011; 6(5)

Pros and Cons of Two Approaches: Machine Learning vs Grammar Engineering

Introduction of Netbase NLP Core Engine

Overview of Natural Language Processing

Dr. Wei Li's English Blog on NLP





https://blog.sciencenet.cn/blog-362400-992419.html

上一篇:【小品:皇帝的女儿】
下一篇:Google SyntaxNet is NOT the “world’s most accurate parser"
收藏 IP: 192.168.0.*| 热度|

0

该博文允许注册用户评论 请点击登录 评论 (0 个评论)

数据加载中...
扫一扫,分享此博文

Archiver|手机版|科学网 ( 京ICP备07017567号-12 )

GMT+8, 2024-5-22 17:44

Powered by ScienceNet.cn

Copyright © 2007- 中国科学报社

返回顶部