Master of Science in Natural Language Processing

Mode
Full-time

Credits
35

Location
On-campus

Overview

Natural language processing (NLP) focuses on system development that allows computers to communicate with people using everyday language. Natural language generation systems convert information from the computer database into readable or audible human language and vice versa. Such systems also enable sophisticated tasks such as inter-language translation, semantic understanding, text summarization and holding a dialog. The key applications of NLP algorithms include interactive voice response applications, automated translators, digital personal assistants (e.g., Siri, Cortana, Alexa), chatbots, and smart word processors.

Program learning outcomes

Upon completion of the program requirements, the graduate will be able to:

  • Demonstrate highly specialized understanding of the computational techniques for analysing and modelling textual and speech data with applications to real-world scenarios.
  • Have a deep understanding of the syntactic and semantic structures in speech and textual data (e.g. the predicate-argument structure).
  • Obtain advanced capabilities to implement the cutting-edge NLP algorithms, and benchmark the achieved results.
  • Have the capability to formulate own research questions, analyse the existing body of knowledge, propose and develop solutions to new problems.
  • Obtain expertise in using and deploying NLP related programming tools for a variety of NLP problems.
  • Work independently as well as part of a team, in a collegial manner, on NLP related projects.
  • Effectively communicate experimental results and research findings orally and in writing, and critique existing body of work.

Completion requirements

The minimum degree requirements for the Master's of Science in Natural Language Processing is 35 credits, distributed as follows:

Core Courses Number of Courses Credit Hours
Core 4 15 Credit Hours
Research Thesis 1 12 Credit Hours
Elective Courses 2 8 Credit Hours

Core courses

MSc in Natural Language Processing is primarily a research-based degree. The purpose of coursework is to equip students with the right skill set, so they can successfully accomplish their research project (thesis). Students are required to take COM701, and the other three core courses as a mandatory course.

Code Course Title Credit Hours
COM701 Research Communication and Dissemination

In this course, students will learn how to effectively communicate and disseminate their research findings, both orally and in written form, to the larger community. In addition to acquiring hard communication skills, students will also be familiarized with how these skills fit into a broader context, learning, for instance, the importance of peer review, how to select a journal or conference for publication, how to measure impact factor, how to gauge and adjust to different audiences, the various ethical issues that can arise, etc.

3
NLP701 Natural Language Processing

This course provides a comprehensive introduction to Natural Language Processing. It builds upon fundamental concepts in Mathematics, specifically probability and statistics, linear algebra, and calculus, and assumes familiarity with programming.

4
NLP702 Advanced Natural Language Processing

This course provides a comprehensive introduction to Natural Language Processing. It builds upon fundamental concepts in Natural Language Processing and assumes familiarization with Mathematical concepts and programming.

4
NLP703 Speech Processing

This course provides a comprehensive introduction to Speech Processing. It builds upon fundamental concepts in Speech Processing and assumes familiarization with Mathematical and Signal Processing concepts.

4

Elective courses

Students will select a minimum of two elective courses, with a total of eight (or more) credit hours (CH) from a list of available elective courses based on interest, proposed research thesis, and career perspectives, in consultation with their supervisory panel. The elective courses available for the Master’s of Science in Natural Language Processing are listed in the table below:

Code Course Title Credit Hours
MTH701 Mathematical Foundations for Artificial Intelligence

This course provides a comprehensive mathematical foundation for artificial intelligence. It builds upon fundamental concepts in linear algebra, probability theory, and basic statistics and overviews basics and advanced topics that are frequently encountered in AI applications. The students will learn the basic mathematical concepts for main AI systems, as well as realistic applications in AI of mathematical tools.

4
MTH702 Optimization

This course provides a graduate-level introduction to the principles and methods of optimization, with a thorough grounding in the mathematical formulation of optimization problems. The course covers fundamentals of convex functions and sets, 1st order and 2nd order optimization methods, problems with equality and/or inequality constraints, and other advanced problems.

4
AI701 Artificial Intelligence

This course provides the students a comprehensive introduction to modern artificial intelligence (AI), and some of its representative applications. The students will be familiarized with both the historical and recent AI techniques that have proven successful in building practical systems.

4
AI702 Deep Learning

This course provides a comprehensive overview of different concepts and methods related to deep learning. Students will first learn the foundations of deep learning, after which they will be introduced to a series of deep models: convolutional neural networks, autoencoders, recurrent neural network, and deep generative models. Students will work on case studies of deep learning in different fields such as computer vision, medical imaging, natural language processing, etc.

4
DS701 Data Mining

This course is an introductory course on data mining, which is the process of discovering patterns in large data sets involving methods at the intersection of machine learning, statistics, and database systems.

4
DS702 Big Data Processing

This course is an introductory course on big data processing, which is the process of analyzing and utilizing big data. The course involves methods at the intersection of parallel computing, machine learning, statistics, database systems, etc.

4
HC701 Medical Imaging: Physics and Analysis

This course provides a graduate-level introduction to the principles and methods of Medical Imaging, with thorough grounding in the physics of the imaging problems. This course covers the fundamentals of X-ray, CT, MRI, Ultrasound, and PET, imaging. In addition, the course provides an overview of 3D geometry of medical images and a few classical problems in medical images analysis including classification, segmentation, registration, quantification, reconstruction and radiomics.

4
ML701 Machine Learning

This course provides a comprehensive introduction to Machine Learning. It builds upon fundamental concepts in Mathematics, specifically probability and statistics, linear algebra, and calculus. Students will learn about supervised and unsupervised learning, various learning algorithms, and basics of learning theory, graphical models, and reinforcement learning

4
ML702 Advanced Machine Learning

This course focuses on recent advances in machine learning and on developing skills for performing research to advance the state of the art in machine learning. Students will learn concepts in kernel methods, statistical complexity, statistical decision theory, computational complexity of learning algorithms, and reinforcement learning. This course builds upon concepts from Machine Learning (ML701) and assumes familiarity with fundamental concepts in machine learning, optimization, and statistics.

4
ML703 Probabilistic and Statistical Inference

Probabilistic and statistical inference is the process of drawing useful conclusions about data populations or scientific truths from uncertain and noisy data. This course will cover different modes of performing inference including statistical modelling, data-oriented strategies, and explicit use of design and randomization in analyses. Furthermore, it will provide an in-depth treatment of the broad theories (frequentists, Bayesian, likelihood) and numerous practical complexities (missing data, observed and unobserved confounding, biases) for performing inference. This course presents the fundamentals of statistical and probabilistic inference and shows how these fundamental concepts are applied in practice.

4
CV701 Human and Computer Vision

This course provides a comprehensive introduction to the basics of human visual system and color perception, image acquisition and processing, linear and nonlinear image filtering, image features description and extraction, classification, and segmentation strategies. Moreover, students will be introduced to quality assessment methodologies for computer vision and image processing algorithms.

4
CV702 Geometry for Computer Vision

The course provides a comprehensive introduction to the concepts, principles and methods of geometry-aware computer vision which helps in describing the shape and structure of the world. In particular, the objective of the course is to introduce the formal tools and techniques that are necessary for estimating depth, motion, disparity, volume, pose and shapes in 3D scenes.

4
CV703 Visual Object Recognition and Detection

This course provides a comprehensive overview of different concepts and methods related to visual object recognition and detection. In particular, the students will learn a large family of successful and recent state-ofthe-art architectures of deep neural networks to solve the tasks of visual recognition, detection, and tracking.

4

Research thesis

The Master’s thesis exposes students to an unsolved research problem, where they are required to propose new solutions and contribute towards the body of knowledge. Students pursue an independent research study, under the guidance of a supervisory panel, for a period of one year.

Code Course Title Credit Hours
NLP699 Master’s Research Thesis

Master’s thesis research exposes students to an unsolved research problem, where they are required to propose new solutions and contribute towards the body of knowledge. Students pursue an independent research study, under the guidance of a supervisory panel, for a period of one year. Master’s thesis research helps train graduates to pursue more advanced research in their Ph.D. degree. Further, it enables graduates to independently pursue an industrial project involving a research component.

12

Admission criteria

Bachelor’s degree in a STEM field such as computer science, electrical engineering, computer engineering, mathematics, physics and other relevant science and engineering majors, from a university accredited or recognized by the UAE Ministry of Education (MoE). Students should have a minimum CGPA of 3.2 (on a 4.0 scale) or equivalent.

Applicants must provide their completed degree certificates and transcripts (in English) when submitting their application. Senior-level students can apply initially with a copy of their transcript and expected graduation letter and upon admission must submit the official completed degree certificate and transcript. A degree attestation (for degrees from the UAE) or an equivalency certificate (for degrees acquired outside the UAE) should also be furnished within their first semester at the university.

Each applicant must show proof of English language ability by providing valid certificate copies of either of the following:

  • TOEFL iBT with a minimum total score of 90
  • IELTS Academic with a minimum overall score of 6.5
  • EmSAT English with a minimum score of 1550

TOEFL iBT and IELTS academic certificates are valid for two (2) years from the date of the exam while EmSAT results are valid for eighteen (18) months. Only standard versions (i.e. conducted at physical test centers) of the accepted English language proficiency exams will be considered.

Waiver requests from eligible applicants who are citizens (by passport or nationality) of UK, USA, Australia, and New Zealand who completed their studies from K-12 until bachelor’s degree and master’s degree (if applicable) from those same countries will be processed. They need to submit notarized copies of their documents during the application stage and attested documents upon admission. Waiver decisions will be given within seven days after receiving all requirements.

A general test certificate is optional and submitting one will be considered a plus during the evaluation.

In an 800-word essay, explain why you would like to pursue a graduate degree at MBZUAI and include the following information:

  • Motivation for applying to the university
  • Personal and academic background and how it makes you suitable for the program you are applying for stand-out achievements, e.g. awards, distinction, etc
  • Goals as a prospective student
  • Preferred career path and plans after graduation
  • Any other details that will support the application

Applicants will be required to nominate referees who can recommend their application. M.Sc. applicants should have a minimum of two (2) referees wherein one was a previous course instructor or faculty/research advisor and the other a previous work supervisor.

To avoid issues and delays in the provision of the recommendation, applicants have to inform their referees of their nomination beforehand and provide the latter's accurate information in the online application portal. Automated notifications will be sent out to the referees upon application submission.

Selected applicants will be invited to participate in an entry exam that will include questions related to the following topics:

  • Math: Basic math questions related to calculus, probability theory, linear algebra, and optimization

M.Sc. applicants are recommended to read about these topics especially on how they are related to machine learning. Online research is encouraged, for instance, searching for “linear algebra for machine learning” on YouTube for useful video lectures. In addition, they can find courses on sites like Coursera, Udemy, and many others. Applicants are encouraged to review as many resources as possible. The following website is recommended for mathematics for machine learning: https://mml-book.github.io

  • Machine learning: No previous background is needed for M.Sc. applicants.
  • Programming

M.Sc. applicants will be asked basic programming questions. Most questions are in Python but the specific language is not a problem since the questions are algorithmic rather than language-specific. Basic understanding about different data structures such as Arrays, Stacks, Queues, etc is important. In addition, it is also important to read about different programming algorithms such as sorting and searching algorithms, and complexity. MSc applicants will be asked questions which require finding the output of a piece of code, finding the problem/error in a short code, and finding the code which performs a specific task.

The exam instructions are available here.
A general admission interview with the Office of Student Affairs will follow.

Study plan

A typical study plan is as follows:

Semester 1

COM701 Research Communication and Dissemination
NLP701 Natural Language Processing
+ 1 Elective

Semester 2

NLP702 Advanced Natural Language Processing
NLP703 Speech Processing
+ 1 Elective OR
NLP699 Master’s Research Thesis

Semester 3

NLP699 Master’s Research Thesis
+ 1 Elective (if not taken in Semester 2)

Semester 4

NLP699 Master’s Research Thesis

Study Plan

Career prospects

AI is permeating every industry. At recent employer engagement events at MBZUAI, there has been representation from multiples sectors including (but not limited to):

  • Aviation, consultancy, education, energy, finance, government entities, healthcare, media, oil and gas, security and defense, research institutes, retail, telecommunications, transportation and logistics, and startups.

Recent job opportunities advertised via the MBZUAI Student Careers Portal include (but not limited to):

  • AI solution architect, AI solution engineer, algorithmic engineer, data analyst, data engineer, data scientist, data strategy consultant, full stack software engineer, full stack web developer, predictive analytics researcher, and senior data scientist - consultant.

Other career opportunities could include (but not limited to):

  • Applied scientist, analytics engineer, augmented/virtual reality, autonomous cars, biometrics and forensics, chief data officer, data platform leadership, data journalist, data and AI technical sales specialist, growth analytics / engineers, manager: AI and cloud services planning, machine learning engineers, product manager: AI and data analytics, product data scientist, product analyst, remote sensing, research assistants, security and surveillance, senior software engineer, and VP data.

Meet the faculty

...

Professor Timothy Baldwin

Associate Provost for Academic and Student Affairs, Acting Department Chair of Natural Language Processing and Professor

...

Dr. Shady Shehata

Associate Professor,
Natural Language Processing

Disclaimer: Subject to change.