目前,編輯工作仍然由人工完成。Microsoft Word內置軟件或Grammarly等拼寫和語法檢查軟件,可以找出語法和拼寫錯誤或標點錯誤。但此類軟件并不能夠告訴用戶如何用完全不同的句子來表達相同的意思。
以色列初創(chuàng)公司AI21 Labs目前推出了一款人工智能編輯工具,完全可以做到這一點。這款工具能夠為用戶推薦不同長度以及不同語氣的句子,并幫助用戶針對特定語境選擇最合適的詞語。該公司由兩位著名的機器學習研究專家和某以色列軍事情報機構的幾位退役軍人共同創(chuàng)立。
AI21的聯(lián)合創(chuàng)始人之一奧里?戈申稱:“我們正在開發(fā)一款真正的書寫伴侶,一個共同撰寫人,而不是文本編輯器?!?/p>
以特朗普總統(tǒng)在2016年總統(tǒng)大選期間發(fā)表的詞不達意的言辭為例:“我知道詞語。我會運用最好的詞語?!盇I21 Labs開發(fā)的軟件可以推薦用不同的句子來表達相同的意思,但使用的詞語甚至在原文中都沒有出現(xiàn)。例如,較為正式的表達:“我是一個文字大師,擁有令人印象深刻的詞匯量?!倍唵蔚仍母逦谋磉_是:“我的詞匯量非常豐富。”該軟件還能夠推薦更冗長的措辭:“我的詞匯量很大,并且善于針對不同的語境選擇最合適的詞語?!?/p>
這款產品名為Wordtune,是谷歌瀏覽器(Google Chrome)的免費擴展程序,可以在Google Docs、Gmail和Sheets等程序中編輯句子,也能夠在Facebook和推特(Twitter)等社交媒體網站上進行編輯。Wordtune目前還不能兼容Microsoft Word,但該公司希望可以很快將Wordtune與Microsoft Word集成在一起。
戈申曾經多次創(chuàng)業(yè),他也是以色列國防軍8200部隊(以色列主要軍事信號情報機構)的退伍軍人。他說,還有幾名8200部隊的退伍軍人也在該公司工作。
2017年,他與以色列兩位最著名的人工智能專家共同創(chuàng)立了AI21 Labs:一位是前斯坦福大學(Stanford University)的人工智能研究員約阿夫?肖漢姆,他將之前的兩家初創(chuàng)公司賣給了搜索巨頭谷歌(Google),并在谷歌工作了兩年;另一位是阿姆儂?沙蘇亞,他是希伯來大學(Hebrew University)的計算機科學家,同時也是Mobileye(英特爾的子公司,為自動駕駛汽車和汽車工業(yè)研發(fā)人工智能軟件)的首席執(zhí)行官。該公司還有一位來自以色列希伯來大學的著名機器學習研究員,沙伊?沙萊夫-施瓦茨。
肖漢姆表示,該公司的遠大目標是利用人工智能“從根本上變革我們的讀寫方式”。
Wordtune就是在過去兩年自然語言處理快速發(fā)展中出現(xiàn)的一款人工智能工具,它能夠操縱并在一定程度上“理解”語言。這些進步得益于兩大發(fā)展:其一是新型神經網絡設計的出現(xiàn),這是一種大致基于人腦的機器學習,稱為Transformer;其二是大量語言模型的出現(xiàn),這些模型有數(shù)百億個變量,并用大量文本塑造而成。
可以自動撰寫或改寫文本的書寫工具有很多,而且還在不斷增加,AI21 Labs正在推出的Wordtune就是其中之一。競爭對手之一Quillbot由芝加哥一家初創(chuàng)公司開發(fā),能夠提供改寫建議,并可以重寫整個段落。谷歌正在逐步將更復雜的自動完成功能融入Gmail等產品中。微軟公司(Microsoft)在Microsoft Word中推出的一個功能,能夠使用人工智能來提供其他句子表達方式。OpenAI創(chuàng)建了最大語言模型之一GPT-3,并且已經授權一家名為OthersideAI的初創(chuàng)公司使用該軟件,該軟件可以根據(jù)一些要點自動生成電子郵件。
肖漢姆表示,與GPT-3不同,AI21 Labs開發(fā)的系統(tǒng)是基于神經網絡的語言模型與一種較早人工智能形式的融合體,它用圖形結構來表達人類認知,如詞匯和詞義。與一些基于超大語言模型的純統(tǒng)計方法相比,這種融合系統(tǒng)在某種程度上能夠讓Wordtune更好地理解一段文字所要表達的含義。
該公司還對大型語言模型的工作原理進行了基礎性研究,并取得了一些突破性進展。今年早些時候發(fā)布的一項成果是對谷歌發(fā)明的一個大型語言模型BERT所作的改進。BERT是隨機掩蓋大文本中的詞語,然后讓人工智能系統(tǒng)預測掩蓋的詞語。AI21 Labs進一步完善了該系統(tǒng),創(chuàng)建了一個名為SenseBERT的人工智能語言模型,在該模型中,掩蓋并非完全隨機,而是會權衡句子中對表達思想最重要的部分。肖漢姆表示:“它可以捕捉到句子的真實含義?!?/p>
該公司還建立了一個名為Haimke系統(tǒng)的研究項目,與OthersideAI構建的系統(tǒng)一樣,Haimke能夠將要點轉換成文字。另一個系統(tǒng)名為Haim,其工作原理有點類似GPT-3,可以根據(jù)幾句話寫出一長段連貫的文字。但Haim又不同于GPT-3,因為Haim的用戶能夠編寫一系列“導航”句子來幫助引導人工智能創(chuàng)建文本。肖漢姆稱,該軟件用新的文字填補了這些導航句之間的空白,而這些導航句則是邏輯路標,因此該軟件不太可能“偏離意思”并生成無意義的文字。目前,這兩款系統(tǒng)均未上市。(財富中文網)
翻譯:郝秀
審校:汪皓
目前,編輯工作仍然由人工完成。Microsoft Word內置軟件或Grammarly等拼寫和語法檢查軟件,可以找出語法和拼寫錯誤或標點錯誤。但此類軟件并不能夠告訴用戶如何用完全不同的句子來表達相同的意思。
以色列初創(chuàng)公司AI21 Labs目前推出了一款人工智能編輯工具,完全可以做到這一點。這款工具能夠為用戶推薦不同長度以及不同語氣的句子,并幫助用戶針對特定語境選擇最合適的詞語。該公司由兩位著名的機器學習研究專家和某以色列軍事情報機構的幾位退役軍人共同創(chuàng)立。
AI21的聯(lián)合創(chuàng)始人之一奧里?戈申稱:“我們正在開發(fā)一款真正的書寫伴侶,一個共同撰寫人,而不是文本編輯器?!?/p>
以特朗普總統(tǒng)在2016年總統(tǒng)大選期間發(fā)表的詞不達意的言辭為例:“我知道詞語。我會運用最好的詞語。”AI21 Labs開發(fā)的軟件可以推薦用不同的句子來表達相同的意思,但使用的詞語甚至在原文中都沒有出現(xiàn)。例如,較為正式的表達:“我是一個文字大師,擁有令人印象深刻的詞匯量?!倍唵蔚仍母逦谋磉_是:“我的詞匯量非常豐富。”該軟件還能夠推薦更冗長的措辭:“我的詞匯量很大,并且善于針對不同的語境選擇最合適的詞語?!?/p>
這款產品名為Wordtune,是谷歌瀏覽器(Google Chrome)的免費擴展程序,可以在Google Docs、Gmail和Sheets等程序中編輯句子,也能夠在Facebook和推特(Twitter)等社交媒體網站上進行編輯。Wordtune目前還不能兼容Microsoft Word,但該公司希望可以很快將Wordtune與Microsoft Word集成在一起。
戈申曾經多次創(chuàng)業(yè),他也是以色列國防軍8200部隊(以色列主要軍事信號情報機構)的退伍軍人。他說,還有幾名8200部隊的退伍軍人也在該公司工作。
2017年,他與以色列兩位最著名的人工智能專家共同創(chuàng)立了AI21 Labs:一位是前斯坦福大學(Stanford University)的人工智能研究員約阿夫?肖漢姆,他將之前的兩家初創(chuàng)公司賣給了搜索巨頭谷歌(Google),并在谷歌工作了兩年;另一位是阿姆儂?沙蘇亞,他是希伯來大學(Hebrew University)的計算機科學家,同時也是Mobileye(英特爾的子公司,為自動駕駛汽車和汽車工業(yè)研發(fā)人工智能軟件)的首席執(zhí)行官。該公司還有一位來自以色列希伯來大學的著名機器學習研究員,沙伊?沙萊夫-施瓦茨。
肖漢姆表示,該公司的遠大目標是利用人工智能“從根本上變革我們的讀寫方式”。
Wordtune就是在過去兩年自然語言處理快速發(fā)展中出現(xiàn)的一款人工智能工具,它能夠操縱并在一定程度上“理解”語言。這些進步得益于兩大發(fā)展:其一是新型神經網絡設計的出現(xiàn),這是一種大致基于人腦的機器學習,稱為Transformer;其二是大量語言模型的出現(xiàn),這些模型有數(shù)百億個變量,并用大量文本塑造而成。
可以自動撰寫或改寫文本的書寫工具有很多,而且還在不斷增加,AI21 Labs正在推出的Wordtune就是其中之一。競爭對手之一Quillbot由芝加哥一家初創(chuàng)公司開發(fā),能夠提供改寫建議,并可以重寫整個段落。谷歌正在逐步將更復雜的自動完成功能融入Gmail等產品中。微軟公司(Microsoft)在Microsoft Word中推出的一個功能,能夠使用人工智能來提供其他句子表達方式。OpenAI創(chuàng)建了最大語言模型之一GPT-3,并且已經授權一家名為OthersideAI的初創(chuàng)公司使用該軟件,該軟件可以根據(jù)一些要點自動生成電子郵件。
肖漢姆表示,與GPT-3不同,AI21 Labs開發(fā)的系統(tǒng)是基于神經網絡的語言模型與一種較早人工智能形式的融合體,它用圖形結構來表達人類認知,如詞匯和詞義。與一些基于超大語言模型的純統(tǒng)計方法相比,這種融合系統(tǒng)在某種程度上能夠讓Wordtune更好地理解一段文字所要表達的含義。
該公司還對大型語言模型的工作原理進行了基礎性研究,并取得了一些突破性進展。今年早些時候發(fā)布的一項成果是對谷歌發(fā)明的一個大型語言模型BERT所作的改進。BERT是隨機掩蓋大文本中的詞語,然后讓人工智能系統(tǒng)預測掩蓋的詞語。AI21 Labs進一步完善了該系統(tǒng),創(chuàng)建了一個名為SenseBERT的人工智能語言模型,在該模型中,掩蓋并非完全隨機,而是會權衡句子中對表達思想最重要的部分。肖漢姆表示:“它可以捕捉到句子的真實含義?!?/p>
該公司還建立了一個名為Haimke系統(tǒng)的研究項目,與OthersideAI構建的系統(tǒng)一樣,Haimke能夠將要點轉換成文字。另一個系統(tǒng)名為Haim,其工作原理有點類似GPT-3,可以根據(jù)幾句話寫出一長段連貫的文字。但Haim又不同于GPT-3,因為Haim的用戶能夠編寫一系列“導航”句子來幫助引導人工智能創(chuàng)建文本。肖漢姆稱,該軟件用新的文字填補了這些導航句之間的空白,而這些導航句則是邏輯路標,因此該軟件不太可能“偏離意思”并生成無意義的文字。目前,這兩款系統(tǒng)均未上市。(財富中文網)
翻譯:郝秀
審校:汪皓
Today, editing is a manual, human process. Spelling and grammar checking software, such as the one built into Microsoft Word or the grammar checker Grammarly, can suggest when a word is incorrectly used or a comma misplaced. But it can't recommend an entirely different way of writing a sentence to convey the same idea.
Now AI21 Labs, an Israeli startup cofounded by two well-known machine learning researchers and several veterans of an elite Israeli military intelligence unit, has debuted an A.I.-enabled editing tool that does exactly that. It can suggest variations of different lengths and tones, as well as help users find the best word to use in a particular circumstance.
"We are developing a true writing companion, a cowriter as opposed to a copy editor," Ori Goshen, one of AI21's cofounders, said.
Take the infamously inarticulate statement from President Trump, uttered when he was still a candidate during the 2016 presidential election campaign: “I know words. I have the best words.” The software AI21 Labs has created can suggest a range of ways to rewrite the sentence to capture the same intent, but using words that don't even appear in the original. These include the more formal, "I am a master wordsmith and possess an impressive vocabulary," as well as a version that's simpler but still more articulate than the original, "I have a wonderfully rich vocabulary." It can also suggest a more verbose phrasing: "I have an extensive vocabulary, and am skilled at choosing the most appropriate term to express myself in a given situation."
The product, called Wordtune, is a free Google Chrome browser extension that can edit sentences in programs like Google Docs, Gmail, and Sheets, as well as within social media sites like Facebook and Twitter. Wordtune does not yet work with Microsoft Word, but the company hopes to integrate it with the well-known word-processing software sometime soon.
Goshen is a serial entrepreneur as well as a veteran of the Israeli Defense Forces’ Unit 8200, the main signals intelligence division of the Israeli military. Several other veterans of the unit also work for the company, he said.
He cofounded AI21 Labs in 2017 with two of Israel's best known A.I. experts: Yoav Shoham, a former Stanford University artificial intelligence researcher who sold two previous startups to Google and worked for the search giant for two years, and Amnon Shashua, a computer scientist at Hebrew University who is also the chief executive at Mobileye, a subsidiary of Intel that makes artificial intelligence software for self-driving cars and the automotive industry. Shai Shalev-Shwartz, another well-known Israeli machine learning researcher at Hebrew University, also does work for the company.
Shoham said that the company's lofty goal is to use A.I. "to fundamentally transform how we read and write."
Wordtune is an example of the rapid advances in natural language processing—a kind of A.I. that can manipulate and to some extent "understand" language—that have occurred in the past two years. These advances have been driven by two developments: a new kind of design for a neural network, a kind of machine learning loosely based on the brain, called a Transformer, and the advent of massive language models that take in tens of billions of variables and are trained on colossal amounts of text.
AI21 Labs is launching Wordtune into an increasingly crowded field of competing writing tools that can automatically compose or rephrase text. A competing system called Quillbot, built by a Chicago startup, suggests paraphrasing and can rewrite whole paragraphs. Google is increasingly incorporating more sophisticated auto-complete functions into its products, including Gmail. Microsoft has launched a feature in Microsoft Word that uses A.I. to suggest alternate ways to phrase a sentence. OpenAI, which has created one of the largest language models, called GPT-3, has licensed the system to a startup called OthersideAI, which uses the software to automatically generate emails from a few bullet points.
Unlike GPT-3, AI21 Labs's system is a fusion between neural network–based language models and an older form of artificial intelligence that seeks to represent human knowledge, like vocabulary and the meaning of words, in a graph structure, Shoham said. This fusion is part of what enables Wordtune to have a much better understanding of the concepts being expressed in a piece of writing than some of the pure statistical approaches based on ultra-large language models.
The company has also made some fundamental research breakthroughs in the way large language models work. One, which it published earlier this year, is an improvement on a large language model invented by Google called BERT. BERT is based on hiding random words in a large text and then asking an A.I. system to predict the hidden words. AI21 Labs refined this system, creating an A.I. language model called SenseBERT, in which the masking is not completely random but is weighted toward the parts of the sentence that are most important for conveying meaning. "This allows it to capture the true sense of a sentence," Shoham said.
As a research project, the company also built a system, which it calls Haimke, that can, like the system built by OthersideAI, turn bullet points into prose. Another system, called Haim, works a bit like GPT-3, composing long coherent passages from a few sentences of human writing. Haim differs from GPT-3, though, in that the human using it can help guide the text the A.I. creates by writing a series of "waypoint" sentences. The software fills in the gaps between these waypoints with novel prose, but the waypoints serve as logical guideposts, so the software is less likely to "run off the rails" and generate nonsensical prose, Shoham said. Neither system has yet been turned into a commercial product.