Feasibility Evidence Description (FED)

Transcription

1 Feasibility Evidence Description (FED) ThrdPlace Social Networking Team #7 Team members Gaurav Doon Yixiang Liu Tao Hu Feng Wen Ronghui Zhang Xin Liu Kan Qi Role Project Manager Operational Concept Engineer Requirement Engineer Prototyper Software Architect Feasibility Analyst Life Cycle Planer 10/23/2013 错误! 未指定书签 i Version Date: 10/23/13

2 Feasibility Evidence Description (FED) ThrdPlace Social Networking Project Version 4.0 Version History Date Author Version Changes made Rationale 09/25/13 Xin Liu (William) 1.0 Initialize the template Risk assessment has been added To record and organize FED for ThrdPlace Social Networking 10/13/13 Xin Liu (William) 1.1 Risk Assessment has been modified and updated To provide more detailed risk assessment 10/14/13 Xin Liu (William) 2.0 Make process feasibility assessment. Evaluate NDI/NCS Approach and its feasibility. To select NDI/NCS model and provide its relative information 10/20/13 Xin Liu (William) 3.0 Modify and upgrade risk assessment. Reevaluate NDI/NCS Approach and its feasibility Analyze business case To make sure NDI/NCS we choose is feasible and achieve ROI. 10/22/13 Xin Liu (William) 3.1 Update NDI/NCS evaluation based on Winbook. Update data based on business case To provide more detailed NDI/NCS s feasibility and calculate ROI more detailedly. 10/23/13 Xin Liu (William) 4.0 Update NDI/NCS evaluation based on Winbook. Draw ROI analysis graph Give conclusion Provide ROI analysis graph, make a summary and recommendation 错误! 未指定书签 4.0 ii Version Date: 10/23/13

3 Feasibility Evidence Description (FED) ThrdPlace Social Networking Project Version 4.0 Table of Contents Feasibility Evidence Description (FED)... 错误! 未定义书签 Version History... 错误! 未定义书签 Table of Contents... ii Table of Tables... iv Table of Figures... v 1. Introduction... 错误! 未定义书签 1.1 Purpose of the FED Document... 错误! 未定义书签 1.2 Status of the FED Document... 错误! 未定义书签 2. Process Feasibility Risk Assessment NDI/NCS Feasibility Analysis Assessment Approach Assessment Results Feasibility Evidence Business Case Analysis Market Trend and Product Line Analysis Cost Analysis Benefit Analysis ROI Analysis Conclusion and Recommendations... 错误! 未定义书签 错误! 未指定书签 4.0 iii Version Date: 10/23/13

4 Feasibility Evidence Description (FED) ThrdPlace Social Networking Project Version 4.0 Table of Tables Table 1: Rationales for Selecting NDI/NCS Model... 2 Table 2: Risk Assessment... 5 Table 3: NDI/NCS Products Listing... 6 Table 4: Evaluation Criteria NDI /NCS Attributes... 7 Table 5: Evaluation Criteria - NDI/NCS features... 7 Table 6: Evaluation Results Screen Matrix for NDI Attributes... 8 Table 7: Evaluation Results Screen Matrix for NDI features... 8 Table 8: Level of Service Satisfiability Evidence... 8 Table 9: Capability Feasibility Evidence... 9 Table 10: Program model Table 11: Market Trend and Product Line Analysis Table 12: Personnel Costs Table 13: Hardware and Software Costs Development Table 14: Hardware and Software Costs Operation Table 15: Benefits of ThrdPlace System Table 16: ROI Analysis 错误! 未指定书签 4.0 iv Version Date: 10/23/13

5 Table of Figures Figure 1: Archetected Agile Process Pattern... 3 Figure 2: Use Single NDI Process Pattern... 4 Figure 3: NDI-Intensive Process Pattern... 4 Figure 4: NCS Process Pattern... 4 Figure 5: ROI Analysis Graph 错误! 未指定书签 v Version Date: 10/23/13

6 1. Introduction 1.1 Purpose of the FED Document FED document is used to record and organize the degree of feasibility of the project based on making risk assessment, analyze feasibility of NDI/NCS and business analysis. Then the key stakeholders can determine whether to proceed into the next level of commitment. 1.2 Status of the FED The version of the feasibility evidence description document improves the risk assessment to make it more detailed, analyzes process feasibility, NDI/NCS feasibility and business case. To choose an appropriate process pattern, the team has analyzed all the criteria and rationals for selecting NDI/NCS model. According to their importance, we finally choose architected agile process pattern as our model. For the risk assessment part, the team has identified all the current clear risks and come up with some ways to mitigate the risks and record it. Through prioritizing their risk exposure, the team evaluates the possibility of each risk s occurrence and records it. In order to choose appropriate NDI/NCS products, our clients and the team make an evaluation and analysis to decide which NDI/NCS candidate products should be used to our project. For the business case analysis part, we analyze the cost and benefit of the project. Based on the estimated data, we achieve ROI figure. In this feasibility evidence description doc, we add the process feasibility, NDI/NCS feasibility and business case analysis parts to the doc. We remove Hunch and Esri in the NDI/NCS part since Hunch is not going to be used while Esri has already been used in the ThrdPlace platform. Also, we add some new potential risks in the risk assessment part. In addition, the project program model and cost, benefit analysis and ROI analysis graph are added in this version. 错误! 未指定书签 Version Date: 10/23/13

7 2. Process Feasibility Table 1: Rationales for Selecting NDI/NCS Model Criteria Importance Project Status Rationales 30 % of NDI/NCS features High Low Most of our development is independent rather than highly dependent on NDIs. Single NDI/NCS Low Low We need at least two NDIs to satisfy the complete solution Unique/ inflexible business High High Thrdplace has relatively strict process Need control over upgrade / maintenance business process for our project. Very high High Only a DBA and a website maintainer are required for daily maintenance. Rapid deployment High High We have two semesters to develop the whole system. Critical on compatibility High High Our new system should be compatible with the original ThrdPlace website. Internet connection independence High High Our system is website based application. Need high level of services / performance High Low Only one LOS is required: max downtime is 3 days per month. Need high security High High Project contributors and creators are caring about the security of their private information. Asynchronous communication High Very low Project and contributor information should be updated synchronously when changes are made. Be accessed from anywhere Low High Since our system is web based, it s necessary for the system to be accessed anywhere with internet access. Critical on mass schedule constraints Medium Medium The system is developed according to ICSM schedule. Lack of personnel capability Medium Medium Most of our team members have web development experience, but nobody has experience in search system development. Require little upfront costs Medium Medium Most of our tools are open source and free. The system only requires cost of server. Require low total cost of ownership Not-so-powerful local machines Medium Low Most NDIs are free and the payment of the ownership of the system is low. Medium High Since the new system will be deployed on the website of 错误! 未指定书签 Version Date: 10/23/13

8 ThrdPlace, a normal local machine can access to the system easily. Figure 1: Architected Agile Process Pattern Figure 2: Use Single NDI Process Pattern Figure 3: NDI-Intensive Process Pattern 错误! 未指定书签 Version Date: 10/23/13

9 Figure 4: Net-Centric Service Process Pattern Based on the comparison of these four figures, We will select Architected Agile Process Pattern as NDI/NCS model. 错误! 未指定书签 Version Date: 10/23/13

10 3. Risk Assessment Table 2: Risk Assessment Risks It may be difficult to predict the time of building the prototype. Because none of our team members has previous experience in search and recommendation system development. The prototype may not satisfy client s expectation. This is due to lack of details in project requirements. Search performance may not satisfy project creators or contributors. It may take long time for project creators or contributors to view the search results and find the one they really need. Recommendation may not satisfy project creators or contributors actual needs. Because creators and contributors only provide limited information to ThrdPlace and it s hard to do recommendation with incomplete knowledge. Influence may not measure the project or contributor s impacts accurately. Because influence is decided by numerous factors and we can only measure it with limited factors. Risk Exposure Potential Probability Magnitude Loss Risk Exposure Risk Mitigations Prototyper, operational concept engineer and architect analyst will research knowledge about search and recommendation system. Besides, they ll investigate the Solr/ Sphinx fulltext search engine and implement the prototype as soon as possible. Schedule more meetings with the clients to know more requirement details and develop prototype iteratively to satisfy client s expectation step by step. Architect analysis will investiage how to elevate the performance of search system, including relevancy, coverage, diversity and freshness of search results. Communicate with clients and suggest collecting more information from project creators and contributors in register module or project-management module of ThrdPlace. Prototyper and operational concept engineer will investigate the mechanism of popular influence measuring service (e.g. Klout) and create a solution best suited to ThrdPlace platform. 错误! 未指定书签 Version Date: 10/23/13

11 4. NDI/NCS Feasibility Analysis 4.1 Assessment Approach NCS assessment approach is given below. We need to choose a full-text search engine from two NDI/NCS Candidate: Solr and Sphinx. Based on NDI/NCS attributes or features, we give appropriate weights to different evaluation criteria. To make a final selection of these NDIs, we need to conduct a detailed comparison between Solr and Sphinx. Then we use evaluation results screen matrix to assign weights according to four team members own experience and views. Evaluate whether the selected NDI/DCS meets the LOS feasibility, capability feasibility and revolutionary feasibility and decide whether the selected NDI/NCS can be used. 4.2 Assessment Results NDI/NCS Candidate Components (Combinations) Table 3: NDI/NCS Products Listing Search Engine NDI/NCS Products Solr, Sphinx Purposes Provide full-text search engine to support search and recommendation system Evaluation Criteria There re two NDI/NCS shown above that are recommended by our clients. Either Solr or Sphinx will be used as the search engine. Based on system requirements and specific features, a list of criteria is used to evaluate the two NDI/NCS candidates. In this case, we d like to provide one group of evaluation criteria for the search feature. After discussing with our client and team members, we will give weights to each of the attributes and features. Table 4: Evaluation Criteria NDI /NCS Attributes No. Evaluation Criteria NDI/NCS Attributes Weight 1 Inter-Component Compatibility 5 2 Functionality 20 错误! 未指定书签 Version Date: 10/23/13

12 3 Maturity of Product 5 4 Ease of Use 20 5 Ease of Maintain 15 6 Cost of Product 15 7 Product Performance 20 Total 100 Table 5: Evaluation Criteria - NDI/NCS Features No. NDI/NCS Features/ Sub Features Weight 1 Full-text Search 25 2 Faceted navigation 20 3 Hit Highlighting 20 4 HTML administration interface 15 5 Extensible through plugins 5 Flexible relevance-boost through function 5 6 queries 7 Caching-queries 10 Total Evaluation Results Screen Matrix The evaluation results screen matrix tables below show the results of components evaluation based on attributes and features criteria and weight. There re four team members as evaluators to do the evaluation. As shown below, the attributes of Solr satisfy 94.5% of the NDI attributes and the features of Solr satisfy 94% of NDI features. In term of Sphinx, the attributes of it satisfy 85% of NDI attributes and the features of it satisfy 84.25% of NDI features. Based on the results of evaluation, Solr is highly recommended as the search engine in our project rather than Sphinx. Table 2: Evaluation Results Screen Matrix for NDI Attributes No W Solr Sphinx AVG Total R1 R2 R3 R4 R1 R2 R3 R4 AVG Total A A A A A A 错误! 未指定书签 Version Date: 10/23/13

13 A Total Table 7: Evaluation Results Screen Matrix for NDI Features No W Solr Sphinx AVG Total R1 R2 R3 R4 R1 R2 R3 R4 AVG Total F F F F F F F Total Feasibility Evidence This section provides the evidence that the LOS, capability and evolutionary are feasible based on Solr Level of Service Feasibility Table 8: Level of Service Satisfiability Evidence--Solr Level of Service Win Condition LOS-1 Max downtime is 3 days in a month Rationale Solr is a mature product that has a high intercomponent compatibility and dependability. It automatically backs up all the indexed data. So, even when the server is down, we will not lose the indexed data. Solr satisfies the level of service that is necessary to our project s client Capability Feasibility Table 9: Capability Feasibility Evidence Capability Requirement Product Satisfaction 错误! 未指定书签 Version Date: 10/23/13

14 CR-1: Display the search results in the map interface CR-2: Project and project contributors can be searched by project contributors/ creators using filters (fund, geography, etc.) CR-3: Search for the most influential projects and creators. Software/Technology used: Esri, Solr Feasibility Evidence: Solr is the search engine used to provide search results. Esri is used to create the map interface displaying the search results. Referred use case diagram: UC-05 Software/Technology used: Solr Feasibility Evidence: Solr is the search engine used to provide search results. Moreover, Solr has the strong feature of faceted navigation, which allows project contributors and creators to explore a collection of information by applying multiple filters. Referred use case diagram:uc-05 Software/Technology used: Solr Feasibility Evidence: Solr is the search engine used to provide search results. To search for the most influential projects and creators, we need to define the word influential clearly to come up with an appropriate algorithm to implement it on the search engine. Referred use case diagram: UC Evolutionary Feasibility For the search engine part, there is no evolutionary requirement now. 错误! 未指定书签 Version Date: 10/23/13

15 5. Business Case Analysis Assumptions: Table 10. Program Model 1) Project contributors and project creators need useful suggestions to increase their influence 2) Project contributors and project creators want to search information they need more easily and conveniently 3) Project creators and contributors want to know their influence. Stakeholders Initiatives Value Propositions Beneficiaries Developers Project contributors on ThrdPlace Project creators on ThrdPlace ThrdPlace Develop search system and recommendation system. Search projects or contributors with filters Get search results ranked by influence Get recommended projects Get recommended contributors Improved management of projects and contributions Increased reach of contributors and creators. Increased use of ThrdPlace platform. Project contributors on ThrdPlace Project creators on ThrdPlace ThrdPlace Cost Development Cost Maintenance Cost Training Cost Benefits Reduced time spent on: 1. Establish projects processing 2. Discover projects processing 3. Make contributions processing Increased: 1. Reach of contributors and creators 2. Recognition of Thrdplace as a professional organization. 错误! 未指定书签 Version Date: 10/23/13

16 5.1 Market Trend and Product Line Analysis Table 11: Market Trend and Product Line Analysis Market Trend Product Line Solr Solr, as a kind of search engine, is very popular around the world. It is an open source enterprise search platform from the Apache Lucene project. Due to its features of fast full-text search, hit highlighting, faceted search, dynamic clustering, database integration and rich document handling, many consumers consider it as the first search engine. Since its open source attribute, it has an active development community, both individuals and companies, who contribute new features and bug fixes. In this case, its market share rises steadily year by year. Apache HTTP Server, Apache Avalon, Axkit, Crimson etc. Sphinx As a free software/open source full text search engine, Sphinx is also popular around the world. Due to its features of full-text indexing, support fro non-text attributes, direct indexing of SQL databases, XML documents indexing support, distributed searching support out of the box etc, it is used by many of the famous websites like Craigslist.org, Tradebit.com, vbulletin.com etc. In this case, its product has a strong power to rise around the world. It also can be used as a stand-alone server. SphinxAPI, SphinxQL, SphinxSE etc. 5.2 Cost Analysis Personnel Costs Table 12: Personnel Costs Activities Time Spent (Hours) Valuation and Foundations Phases: Time Invested (CS577a, 12 weeks) Client: Meetings and s with team to identify goals and plan project 48 and WinWin sessions (1 meeting/week * 2 hours *12 weeks * 1 person + 2 s/week * 1 hour *12 weeks * 1 person) Thrdplace committee: Meeting with client to clarify plan project and goals 48 and answer related questions come up with by our team members (2 hours/week * 12 weeks * 2 people) Client: Architecture Review Board (2 sessions * 1.5 hours * 1 person) 3 Development and Operation Phases: Time Invested (CS577b, 12 weeks) Client: Meetings with the development team face to face and answer 48 questions via s/phone(1 meeting /week* 2 hours * 1 person * 12 weeks+ 2 s/week * 1 hour *12 weeks * 1 person) 错误! 未指定书签 Version Date: 10/23/13

17 Thrdplace committee: Meeting with client to know the progress of 48 development and answer related questions come up with by our team members (2 hours/week * 12 weeks * 2 people) Client: Architecture Review Board (2 sessions * 1.5 hours * 1 person) 3 Deployment of system in operation phase and training 38 - Installation & Deployment (5 hours * 2 times * 2 people) - Training & Support (3 hours * 3 times * 2 people) Total Initial Investment 236 Maintenance Period (1 year) Maintenance ( 3 hours/week * 52 weeks) 156 Total Hardware and Software Costs Table 13: Hardware and Software Costs--Development Type Cost Rational Web Server 0 We will share the web server with Thrdplace MySQL database 0 We will share database with Thrdplace PHP 0 Free server-side scripting language Apache Solr 0 Free open source search engine Total 0 Table 14: Hardware and Software Costs--Operation Type Cost Rational Web Server 0 We will share the web server with Thrdplace MySQL database 0 We will share database with Thrdplace Total Benefit Analysis Table 15: Benefits of ThrdPlace System Current activities & resources used % Reduce Time Saved (Hours/Year) Establish projects processing Administrator(300 projects * 40 mins per project = mins) 70% 140 Discover projects processing Administrator(200 projects * 30 mins per project = 6000 mins) 90% 90 Make contributions processing 错误! 未指定书签 Version Date: 10/23/13

18 Administrator(300 projects * 40 mins per project = mins) 80% 160 Project contributors/creators (10 min to make contributions) 50% 25 Total ROI Analysis Assume: 1. 10% per year increase in cost. 2. Benefits rounded up to nearest integer 3. ROI=(Cumulative Benefit - Cumulative Cost)/(Cumulative Cost) Table 16: ROI Analysis Year Cost Benefit Cumulative Cumulative (Effort Saved) Cost Benefit ROI Figure 5: ROI Analysis Graph 错误! 未指定书签 Version Date: 10/23/13

19 6. Conclusion and Recommendations Feasibility evidence description provides an analysis and assessment for the risks, process pattern, NDI/NCS and business case. There re several risks that may occur in the future. For each of them, we provide the methods of mitigation. After measuring the importance of each process criteria, our team selects architected agile pattern as our process pattern. For the NDI/NCS feasibility analysis part, to build a search engine, two NDI candidate components are provided. After analyzing the evaluation criteria, LOS feasibility, capability feasibility and evolutionary feasibility, Solr, as a search platform, is selected as our search engine.then based on the business case analysis, we achieve the ROI figure finally. 错误! 未指定书签 Version Date: 10/23/13