Parallel Computing For Machine Learning: [Essay Example], 1078 words GradesFixer

Haven't found the right essay?

Get an expert to write your essay!


Professional writers and researchers


Sources and citation are provided


3 hour delivery

This essay has been submitted by a student. This is not an example of the work written by professional essay writers.

Parallel Computing for Machine Learning

Download Print

Pssst… we can write an original essay just for you.

Any subject. Any type of essay.

We’ll even meet a 3-hour deadline.

Get your price

121 writers online

Download PDF


In the new global economy, Machine Learning has become a central issue for most research field as it offer a techniques to deal with tremendous demanding real-world problem. The study of machine learning is important for addressing fundamental question related to scientific and engineering. There is three subdomain of machine learning whereas; Supervised learning in which the training will be held only if the data have been labelled and consist of input and desired output, Unsupervised learning where the training data didn’t need any labelled and the environment only produced input without specific targets and lastly reinforcement learning which the characteristic of information available in the training data stand between supervised and unsupervised and this kind of learning is happening from feedback received through interactions with external environments.

Both supervised and unsupervised learning is suitable for data analysis while reinforcement learning is suite to handle problem that consist of decision making process. As the rapid emerging of machine learning trends, the need for improving the traditional machine learning to the modern machine learning is very important. The improvement in term of software(algorithm) and hardware is the key in order to come out with advanced machine learning that able to deal with current machine learning issued. In several advanced learning method have been mention in order to improve the traditional machine learning including; Representation learning, Deep learning, Distributed and Parallel learning, Transfer learning, Active learning and Kernel-based learning.

The parallel learning is basically based on the parallel computing environment. Parallel computing defined as a set of interlink process between processing elements and memory modules. In machine learning, parallel computing have improved the traditional machine learning by implemented the used of multicore processor instead of single processor[2]. Some researcher have discussed and applied the parallel computing in order to deal with machine learning issued. Qiu et. al. come with a review paper that discussed on how big data have been processed by using machine learning. As data become big and complex, traditional machine learning face difficulty to train those data. Therefore, six advanced learning methods have been introduced as stated previously. Then, five issued of machine learning in big data have been discussed.

One of the issues including understanding large scale of data. In order to solve this issued, distributed framework based on parallel computing is suggested. Alternating direction method of multipliers(ADMM), the framework that can produce algorithm with capability to scatter and scaling is very suitable. ADMM able to split multiple problems and helps to identify solution by coordinating those solutions into smaller group of problems. Next, the used of parallel programming methods have also been mentioned to solve the large-scale of data sets issued. After that, Memeti et. al. review on two techniques for scheduling parallel computing systems which is Machine Learning and Meta-heuristic techniques. As parallel computing usually involved with problem that is very complex and resource intensive so, the used of multiple processing unit is needed.

The combination of CPUs, GPUs and FPGAs is always being done by researcher to come out with higher performance, and energy efficiency environments. In this paper, Memeti et. al. also discussed on several popular algorithms for machine learning; Linear Regression(LR), Descision Tree(DT), Support Vector Machine (SVM), Bayesian Inference (BI), Random Forest (RF), and Artficial Neural Network (ANN). Then, Memeti et. al. explains characteristic of problem that can be handle by either machine learning and meta-heuristic techniques based on suitable approaches.

Next, the framework that based on parallel computing architecture have been developed. Chiao et. al. come with paper that aim to train real-time trading model by collecting a set of similar historical financial.

Current method used

AdaBoost algorithm have been improved to joint-AdaBoost algorithm and applied with Open Computing Language (OpenCL) parallel computing platform. OpenCL is an open standard framework that designed for multiple platforms. Its provided an architecture for parallel computation and build with API, completed programming language, programming libraries and a runtime. Then, it allowed implementation of complex algorithms by user. OpenCL consist of CPU and GPGPU (General-purpose computing in processing unit) that support data and task parallel programming model. Besides, Pratama et. al. come with paper that help reorganizing Japanese handwritten image using combination of Auto-Encoder algorithm and Residual Block framework with CUDA architecture that support programming library and rely on parallel computing. The used of OpenCL in Chiao and Residual Block in Pratama et. al. has proved that parallel computing framework will helps to reduce the time taken for process of training data. Next, both paper also find out that the used of CPU is more efficient compared to GPU.

Then, Cybenko analyse on how parallel computing been applied in machine learning for handling social network. Cybenko suggested three critical ingredients in order to identify either applying machine learning is compulsory:

  • dealing with large number of data sets,
  • types of software that available to implement those learning process,
  • related computing cycles.

As social network dealing with large number of data sets, therefore applying machine learning is compulsory. Furthermore, current machine learning used single core GPU which is time consuming. Therefore, Cybenko suggested the used of multiprocessor either CPU or GPU is very helpful in order to reduce the training time as social network have a lot of data and need to be handle quickly and efficiently. In the experiment, Cybenko also figure out that the used of CPU is more efficient compared to GPU. Table 1 below will conclude al off five paper that have discussed regarding the application of parallel computing in machine learning.


  1. G. Cybenko, “Parallel Computing for Machine Learning in Social Network Analysis,” 2017.
  2. M. I. Jordan and T. M. Mitchell, “Machine learning: Trends, perspectives, and prospects,” Science (80-. )., vol. 349, no. 6245, pp. 255–260, 2015.
  3. J. Qiu, Q. Wu, G. Ding, Y. Xu, and S. Feng, “A survey of machine learning for big data processing,” EURASIP J. Adv. Signal Process., vol. 2016, no. 1, 2016.
  4. J. Byrne et al., “A Review of Cloud Computing Simulation Platforms and Related Environments,” Proc. 7th Int. Conf. Cloud Comput. Serv. Sci., no. April, pp. 679–691, 2017.
  5. S. Memeti and J. Kołodziej, “A Review of Machine Learning and Meta-heuristic Methods for Scheduling Parallel Computing Systems,” 2018.
  6. C. Chen, S. Huang, and Y. Chang, “Decision Support System for Real-Time Trading based on On-Line Learning and Parallel Computing Techniques,” 2016.
  7. M. O. Pratama and P. Kareen, “Reconstructing Japanese Handwritten Images Using Auto-Encoder with Residual Block in Parallel Computing,” no. ICELTICs, pp. 231–234, 2017.

Remember: This is just a sample from a fellow student.

Your time is important. Let us write you an essay from scratch

100% plagiarism free

Sources and citations are provided

Find Free Essays

We provide you with original essay samples, perfect formatting and styling

Cite this Essay

To export a reference to this article please select a referencing style below:

Parallel Computing For Machine Learning. (2020, January 03). GradesFixer. Retrieved November 30, 2020, from
“Parallel Computing For Machine Learning.” GradesFixer, 03 Jan. 2020,
Parallel Computing For Machine Learning. [online]. Available at: <> [Accessed 30 Nov. 2020].
Parallel Computing For Machine Learning [Internet]. GradesFixer. 2020 Jan 03 [cited 2020 Nov 30]. Available from:
copy to clipboard

Sorry, copying is not allowed on our website. If you’d like this or any other sample, we’ll happily email it to you.

    By clicking “Send”, you agree to our Terms of service and Privacy statement. We will occasionally send you account related emails.


    Attention! this essay is not unique. You can get 100% plagiarism FREE essay in 30sec

    Recieve 100% plagiarism-Free paper just for 4.99$ on email
    get unique paper
    *Public papers are open and may contain not unique content
    download public sample

    Sorry, we cannot unicalize this essay. You can order Unique paper and our professionals Rewrite it for you



    Your essay sample has been sent.

    Want us to write one just for you? We can custom edit this essay into an original, 100% plagiarism free essay.

    thanks-icon Order now

    Hi there!

    Are you interested in getting a customized paper?

    Check it out!
    Having trouble finding the perfect essay? We’ve got you covered. Hire a writer uses cookies. By continuing we’ll assume you board with our cookie policy.