Milliy korpusini

import os, os.path
mypath=os.path.expanduser('~/nltk_data')
print(mypath);
if not os.path.exists(mypath):
os.mkdir(mypath)
print('folder has been created')
else:
print('folder alredy exist')

import nltk.data
varbool = mypath in nltk.data.path
print(varbool)
newfile=nltk.data.load('corpora/tom.txt')
from nltk.tokenize import sent_tokenize, word_tokenize
sent_arr=sent_tokenize(newfile)
arr_word=word_tokenize(newfile)

def find1(sen,f):
for i in len(sen):
return sen[i:i+len(f)]==f

q=input("Matn kiriting:")

for k in range(len(sent_arr)):
print(sent_arr[k])
if find1(sent_arr[k],q):
print(sent_arr[k])

O`zbek milliy korpusi uchun dastur yaratish masalasini yechish hozirgi kunning dolzarb masalasi bo`lgani uchun hozirgacha yuqorida keltirilgan ishlarni amalga oshirdik. Kelejakda bu masala bo`yicha qilinadigan ishlar ko`p. Xulosa sifatida shuni aytish mumkinki, milliy korpusga ega bo‘lish faqatgina tarjimon va tilshunoslarga foydali bo‘lmasdan, balki o‘zbek tilining xalqaro miqyosda obro‘sini oshiradi, o‘zbek tilining davlat tilidan xalqaro til sifatida o‘z o‘rniga ega bo‘lishini kafolatlaydi[1].

Adabiyotlar

1. 
   VI International Conference on Computer Processing of Turkic Languages.TurkLang.2018.
   
2. 
   Natural Language Processing with Python by Steven Bird, Ewan Klein, and Edward Loper.
   
3. 
   Baker, M. (1993) ‘Corpus linguistics and translation studies: implications and applications’ // Korpus lingvistikasi va tarjimashunoslik.
   
4. 
   Bernadini, S., D. Stewart and F. Zanettin ‘Corpora in translation education: an introduction’// Tarjimani o‘rgatishda korpus, 1–14 b.
   
5. 
   J.Munday Introducing translation studies: theories and applications. Routlidge Publishing, New York, 2008 // Tarjimashunsolikka kirish: nazariya va amaliyot.
   
6. 
   Laviosa, S. (1998a) ‘The corpus-based approach: a new paradigm in translation studies’, Meta 13.4: 474–9 // Korpusga asoslangan yo‘nalish: tarjimashunoslikdagi yangi paradigma.
   
7. 
   Levý, J. (1967/2000) ‘Translation as a decision process’, in L. Venuti (ed.) (2000): 148–59 // Tarjima qaror qilish jarayoni sifatida.
   
8. 
   Vinay, J.-P. and J. Darbelnet (1958, 2nd edition 1977) Comparative Stylistics of French and English // Fransuz va ingliz tillarining qiyosiy stilistikasi.
   
9. 
   http://nlp.lsi.upc.edu/freeling/demo/demo.php.
   
10. 
    https://corpus.byu.edu