Difference between revisions of "Big Data Integration"

From Sinfronteras
Jump to: navigation, search
(Tag: Replaced)
 
(95 intermediate revisions by the same user not shown)
Line 1: Line 1:
==Module Information==
+
[[Media:Exploration_of_the_Darts_dataset_using_statistics.pdf]]
 
 
===Module Objectives===
 
* How to implement a cloud based storage solution for a company's big data needs
 
* The knowledge needed to integrate desktop and web applications to utilize web services and stored data.
 
* How cloud based DNS solutions can help to optimize a company's IT infrastructure
 
* How cloud based servers and service implementations can be easily deployed for rapid utilisation
 
* The steps involved in data exchange between web services and cloud based applications
 
 
 
===Resources - References===
 
* Programming Amazon EC2, Juirg van Vliet 1st 2011 O’Reilly
 
* Google Compute Engine, Marc Cohen 1st 2011 O’Reilly
 
* Python for Google App Engine, Massimiliano Pippi 1st 2015 Packet
 
* Big Data Fundamentals Concepts, Drivers & Techniques, Thomas Erl, Wajid Khattak, and Paul Buhler, Prentice Hall
 
 
 
 
 
==Service-Oriented Architecture (SOA)==
 
* A service-oriented architecture (SOA) is a style of software design where services are provided to the other components by application components, through a communication protocol over a network.
 
 
 
* A service is a discrete unit of functionality that can be accessed remotely and acted upon and updated independently, such as retrieving a credit card statement online.
 
 
 
* SOA provides access to reusable Web services over a TCP/IP network,
 
 
 
==XML==
 
 
 
==Web service==
 
* A software component stored on one computer that can be accessed via method calls by an application (or other software component) on another computer over a network
 
 
 
* Web services communicate using such technologies as:
 
** XML, JSON and HTTP
 
** '''Simple Object Access Protocol (SOAP):''' An XML-based protocol that allows web services and clients to communicate in a platform-independent manner
 
 
 
 
 
'''Basic concepts:'''
 
* '''Remote machine or server:''' The computer on which a web service resides
 
* '''A client application''' that accesses a web service sends a method call over a network to the remote machine, which processes the call and returns a response over the network to the application
 
* '''Publishing (deploying) a web service:''' Making a web service available to receive client requests.
 
* '''Consuming a web service:''' Using a web service from a client application.
 
* In Java, a web service is implemented as a class that resides on a server.
 
 
 
 
 
'''An application that consumes a web service (client) consists needs:'''
 
* An object of a '''''proxy class''''' for interacting with the web service.
 
* The ''proxy object'' handles the details of communicating with the web service on the client's behalf
 
 
 
==Consuming a Web Service in Java using NetBeans IDE==
 
Netbeans 6.5 - 9 and Java EE enable programmers to "publish (deploy)" and/or "consume (client request)" web services
 
 
 
This document provides step-by-step instructions to consume a web service in Java using NetBeans IDE.
 
 
 
In the project, we will invoke a sorting web service through its WSDL link: http://vhost3.cs.rit.edu/SortServ/Service.svc?singleWsdl.
 

Latest revision as of 15:54, 11 September 2024