Recognizing language of a short text? - Python

Posted by RadiantHex on Stack Overflow See other posts from Stack Overflow or by RadiantHex
Published on 2010-03-22T17:49:30Z Indexed on 2010/03/22 17:51 UTC
Read the original article Hit count: 308

Filed under:

python

|

language

|

natural-language

|

english

Hi folks,

I'm have a list of articles, each article has its own title and description.

Unfortunately, from the sources I am using, there is no way to know what language they are written.

Also, text is not entirely written in 1 language; almost always English words are present.

I reckon I would need dictionary databases stored on my machine, but it feels a bit unpractical.

What would you suggest I do?

© Stack Overflow or respective owner

Related posts about python

unmet dependencies in Ubuntu 12.04

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I tried today to install a dvb-card on my Ubuntu 12.04 (Linux blauhai-linux 3.2.0-25-generic #40-Ubuntu SMP Wed May 23 20:30:51 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux ). The installation failed with an error. After that, i tried to install python (it was already installed but i got this error): linux:~$… >>> More
How can I get sikuli-ide to work?

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I installed sikuli-ide with sudo apt-get install sikuli-ide Everything was fine until I tried to start it from the terminal. I typed sikuli-ide But the only response I got was [info] locale: en_US The application was not started, furthermore there is no desktop file and sikuli-ide does not… >>> More
Getting PATH right for python after MacPorts install

as seen on Super User - Search for 'Super User'
I can't import some python libraries (PIL, psycopg2) that I just installed with MacPorts. I looked through these forums, and tried to adjust my PATH variable in $HOME/.bash_profile in order to fix this but it did not work. I added the location of PIL and psycopg2 to PATH. I know that Terminal is… >>> More
call python with system() in R to run a python script emulating the python console

as seen on Stack Overflow - Search for 'Stack Overflow'
I want to pass a chunk of Python code to Python in R with something like system('python ...'), and I'm wondering if there is an easy way to emulate the python console in this case. For example, suppose the code is "print 'hello world'", how can I get the output like this in R? >>> print… >>> More
Python - Calling a non python program from python?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I am currently struggling to call a non python program from a python script. I have a ~1000 files that when passed through this C++ program will generate ~1000 outputs. Each output file must have a distinct name. The command I wish to run is of the form: program_name -input -output -o1 -o2… >>> More

Related posts about language

Match language code with countries where this language is an official or commonly used language

as seen on Stack Overflow - Search for 'Stack Overflow'
Is there any python library to get a list of countries for a specific language code where it is an official or commonly used language? For example, language code of "fr" is associated with 29 countries where French is an official language plus 8 countries where it's commonly used. >>> More
"Page description language" and "markup language"

as seen on Stack Overflow - Search for 'Stack Overflow'
What is the difference and relation between "Page description language"(http://en.wikipedia.org/wiki/Page_description_language), "markup language" (http://en.wikipedia.org/wiki/Markup_language) and "Page description markup language" (http://en.wikipedia.org/wiki/Page_description_markup_language)… >>> More
Add keyboard languages to XP, Vista, and Windows 7

as seen on How to geek - Search for 'How to geek'
Do you regularly need to type in multiple languages in Windows? Here we’ll show you the easy way to add and change input languages to your keyboard in XP, Vista, and Windows 7. Windows Vista and 7 come preinstalled with support for viewing a wide variety of languages, so adding an input language… >>> More
Change the User Interface Language in Vista or Windows 7

as seen on How to geek - Search for 'How to geek'
Would you like to change the user interface language in any edition of Windows 7 or Vista on your computer? Here’s a free app that can help you do this quickly and easily. If your native language is not the one most spoken in your area, you’ve likely purchased a PC with Windows preinstalled… >>> More
Change the User Interface Language in Ubuntu

as seen on How to geek - Search for 'How to geek'
Would you like to use your Ubuntu computer in another language? Here’s how you can easily change your interface language in Ubuntu. Ubuntu’s default install only includes a couple languages, but it makes it easy to find and add a new interface language to your computer. To get started… >>> More