Question in System Integration The purpose of this assignme

Question in System Integration :

The purpose of this assignment is to describe your anticipated project plan in a written Project Plan Concept. Case Scenario: You will act as the IT manager of an organization who is tasked with integrating a new software implementation. You are free to choose the software for this project, if you want then you can choose your senior project-1 Project definition. You will then write a 5-page name as \"project planning Template\" summarizing the software for following points: About your software The advantages and disadvantages of your software How the company will use it? Why it is necessary? and How this implementation will meet the company\'s budgeting needs? You will then complete the software systems integration project-planning template. The data used for the project plan template can be completely fictitious, as you will be graded on your abilities to incorporate a solid plan.

Solution

Project Planning Template

The Introduction provides a high level overview of the project and what is included in this Project Management Plan. This should include a high level description of the project and describe the projects deliverables and benefits. This section of the project plan template should provide a summarized framework of the project and its purpose. It includes details regarding the software and how company will be using in this project. What are the different aspects of this software and gives value to the project. Excessive detail is not necessary in this section as the other sections of the project plan will include this information.

Soft Solution Incorporated (SSI) has recently approved the Big data project to move forward for project initiation within the research and development (R&D) group. This project will result in the development and analysis of big data and supports SSI’s corporate strategy of providing progressive solutions to clients which improve productivity in both the workplace and home environment. Big Data software is currently available and it is open source, easily available on internet, SSI believes that new technological developments will enable our team to develop a solution far superior to what is currently available.

SSI has been successful in gaining market share because of its aggressive pursuit of product quality, ease of use, flexibility, and customer service. Additionally, customers understand that our services may be applied to a wide range of uses for business and personal functions. By leveraging our reputation for superior quality and user-friendly products, and capitalizing on new technology, SSI can position itself as the premier provider of effective result or analysis in market place.

About Software:

Hadoop is an open source, Java-based programming framework that supports the processing and storage of extremely large data sets in a distributed computing environment. It is part of the Apache project sponsored by the Apache Software Foundation. The Apache Hadoop software library is essentially a framework that allows for the distributed processing of large datasets across clusters of computers using a simple programming model. Hadoop can scale up from single servers to thousands of machines, each offering local computation and storage. Hadoop makes it possible to run applications on systems with thousands of commodity hardware nodes, and to handle thousands of terabytes of data. Its distributed file system facilitates rapid data transfer rates among nodes and allows the system to continue operating in case of a node failure. This approach lowers the risk of catastrophic system failure and unexpected data loss, even if a significant number of nodes become inoperative. Consequently, Hadoop quickly emerged as a foundation for big data processing tasks, such as scientific analytics, business and sales planning, and processing enormous volumes of sensor data, including from internet of things sensors.

Hadoop and its Dependencies

As a software framework, Hadoop is composed of numerous functional modules. At a minimum, Hadoop uses Hadoop Common as a kernel to provide the framework\'s essential libraries. Other components include Hadoop Distributed File System (HDFS), which is capable of storing data across thousands of commodity servers to achieve high bandwidth between nodes; Hadoop Yet Another Resource Negotiator (YARN), which provides resource management and scheduling for user applications; and Hadoop MapReduce, which provides the programming model used to tackle large distributed data processing -- mapping data and reducing it to a result.

Hadoop also supports a range of related projects that can complement and extend Hadoop\'s basic capabilities. Complementary software packages include:

· Apache Flume. A tool used to collect, aggregate and move huge amounts of streaming data into HDFS.

· Apache Hive. A data warehouse that provides data summarization, query and analysis;

· Cloudera Impala. A massively parallel processing database for Hadoop, originally created by the software company Cloudera, but now released as open source software;

·  Apache Oozie. A server-based workflow scheduling system to manage Hadoop jobs;

·  Apache Pig. A high-level platform for creating programs that run on Hadoop;

· Apache Sqoop. A tool to transfer bulk data between Hadoop and structured data stores, such as relational databases;

· Apache Spark. A fast engine for big data processing capable of streaming and supporting SQL, machine learning and graph processing;

·Apache ZooKeeper. An open source configuration, synchronization and naming registry service for large distributed systems.

We will be using cloudera distribution of Hadoop in this project. We are using cloudera because it is distributed package of different Hadoop ecosystem. It is user friendly and easy to use. Since it has been newly launched, Training to our employees will be easily available.

We will be using 40 node clusters for this project. We will be using 3 master node and else slave node/data node. Our hardware vendor is IBM.

The Project Manager will be responsible for managing and reporting on the project’s cost throughout the duration of the project. The Project Manager will present and review the project’s cost performance during the monthly project status meeting. Using earned value calculations, the Project Manager is responsible for accounting for cost deviations and presenting the Project Sponsor with options for getting the project back on budget.

Since Hadoop runs on commodity hardware. We will be easily installing environment for this project. Commodity hardware is easily available and at low cost. The budget allocated with this project will be easily manageable with this technology.

Earned value calculations will be compiled by the Project Manager and reported at the monthly project status meeting. If there are indications that these values will approach or reach the critical stage before a subsequent meeting, the Project Manager will communicate this to the Project Sponsor immediately.