Page 1 of . Assessment item 1 Sections: Data Preparation and Experimental Design Value: 20% Due date: 19-Mar-2017 no delays must be required on the due date Words limit: 1750 words Task Data preparation/data collection/numerical experiment design: 1. Based on the title, introduction and literature review that you conducted in ITC713 you should now justify the reason for taking an empirical research approach for your paper. You also need to evaluate different research approaches very briefly. Typically, this task should be written within a paragraph of your paper and should be located somewhere in the Methodology or Experiment section depending on your individual project and the paper. 2. You are expected to develop a new and non-obvious technique/algorithm/solution to answer the problem that you want to address. This is the core contribution of your paper and research. Your proposed solution in ideal case should be rationally and mathematically (if possible) justified i.e. you need to convince your readers why and how the proposed solution advances the knowledge, and is expected to solve the problem. You also need to justify your solution. In other words you need to sell your idea in this section. Ideally, this should be located in the “Our Technique” or “Methodology” section of your paper and can be as long as it requires being. Generally this section can be around 30% to 40% of your paper size. So if you are writing a 20 page paper you can afford to spend around 7-8 pages for this. Quality is more important than quantity. 3. Since this paper is based on an empirical research approach, you need to collect data that is suitable and sensible for your research. In many cases you can download sample data that are generally used for the similar research by the community. You may have some clear idea on the most commonly used datasets from your literature review. In this case you generally need to introduce and explain the datasets in your Experiment section of the paper. It is generally expected to use several datasets (instead of just one) in order to demonstrate the usefulness of the proposed solution/algorithm on more than one datasets to convince your readers that the positive experimental result has not just been achieved by luck. Often researchers use both natural datasets (that can be downloaded from some suitable data repositories as explained above) and synthetic dataset that is created artificially to demonstrate the advantages of the proposed solution to solve the research question. You need to clearly explain the purpose and process of creating the synthetic data so that a reader can recreate the same or very similar datasets if they wanted. However, if you need to collect new data for your research then you may have a new section called “Data Collection” where you need to explain the ITC714 - Research Development in IT What is your subject about? A brief overview This subject builds on the extensive review of the research topic in the area of Information Technology (IT) that students commenced in previous coursework subjects in the course. The subject requires students to reflect on their research plan, develop a detailed research proposal, with ethics approval as appropriate, defend their research proposal, and collect data using appropriate data collection techniques. Students will develop expertise relating to a major research issue and will have the opportunity to publish their research in academic conference proceedings or refereed journals. How you are expected to engage with the subject This is the last coursework subject that you have in DIT and is the continuation of the research projects that have commenced, particularly the project in ITC713. There are six topics in the subject: 1. 2. 3. 4. 5. 6. Generic Research Approaches; Empirical Research Methods; Statistical Basics, Data Analysis and Knowledge Discovery; Statistical Test and Analysis; Analysing, Interpreting and Synthesizing Research Results for the Presentation of Research Findings; and Reviewing and Publishing. One of the main objectives of this subject is conducting the research project you have formulated in ITC713 and producing a publishable paper by the end of the session. Another important objective is to prepare a research proposal for your DIT studies. There are four assessment items that are designed to help you achieving these objectives. Doctor of Information Technology Course In previous semester ITC713 my topic was "Big Data with Cloud Computing: The New Value Enhancer for Companies" All the previous assessments are available for any kind of helpPage 2 of 4 purpose and process. 4. Given that you have a novel and convincing algorithm/solution to the research question, and a number of datasets that can be used to demonstrate the strength of your solution you now need to explain your experimental plan i.e. exactly how you are going to use your datasets to demonstrate the strengths of your technique. This can be somewhere at the beginning of your Experiment section in the paper. You need to explain the experiment plan so that a reader understands the significance of the experiment and can repeat the experiments if he/she wanted. In your experiment plan you may want to compare your algorithm/solution with a few existing ones that you have discussed in your literature review section. This will help you to demonstrate the strengths of your technique over the existing ones. In case there is no such existing solution in the literature you may devise one or two sensible and obvious solutions other than the one that you are proposing and show the advantages of your proposed technique. Rationale The assessment item is designed to help you to build skills in conducting empirical research approach by requiring you to: articulate the research process, develop an appropriate research proposal and identify any research issues that may arise when designing the appropriate research method for the chosen area of research; implement data collection techniques/methods, analyse results and judge the appropriateness of the research techniques/methods to the research problem, addressing ethical considerations; Marking criteria Assessment Criteria Performance Standards FL (Does not meet the PS requirements) 0 – 49 % PS (Meets the requirements below) 50 – 64 % CR (Meets PS requirements plus those below) 65 – 74 % DI (Meets CR requirements plus those below) 75 – 84 % HD (Meets DI requirements plus those below) 85 – 100 % 0 - 1.99 2.0 - 2.59 2.60 - 2.99 3.0 - 3.39 3.4 - 4.0 marks Justify the reason for taking an empirical research approach for your paper. (4 marks) The research approach is NOT clear. It is clear that an empirical research approach is being taken. A solid justification of the empirical research approach has been provided considering the research topic. The answer is easy to understand and without A clear evaluation of the various research approaches has been provided. The answer is very well written.Page 3 of 4 any grammatical errors. 0 - 1.99 2.0 - 2.59 2.60 - 2.99 3.0 - 3.39 3.4 - 4.0 Academic and information integrity and literacy. (4 marks) Incorrect or no APA referencing provided. Some bibliographic details missing. Lacking the systematic use of APA referencing tools and techniques. APA citation formats incorrect or need refinement. Most bibliographic details and entries are correct. Better APA citation used with good use of APA format, tools and techniques. Bibliographic details correct and proper use of APA citation system, tools and techniques Bibliographic details and APA citation format correct. Highly evolved use of APA referencing tools and techniques 0 - 1.99 2.0 - 2.59 2.6 - 2.99 3.0 - 3.39 3.4 - 4.0 Develop a new and non-obvious technique/algorithm/solution to answer the problem that you want to address. (4 marks) The proposed technique, algorithm or solution is NOT new. The answer is NOT easy to understand or has grammatical errors. A new technique, algorithm or solution has been developed. The answer is easy to understand and without any grammatical errors. The answer is very well written. The total page limit of 7-8 pages for the answer is considered. The answer is informative, nonrepetitive, concise and non-redundant. The proposed technique, algorithm or solution is a non-obvious improvement of the existing approaches. A rational and mathematical (if possible depending on the research topic) justification of the proposed technique, algorithm or solution is provided. The overall writing is convincing as it explains why and how the proposed solution advances the knowledge, and is expected to solve the problem. 0 - 1.99 2.0 - 2.59 2.6 - 2.99 3.0 - 3.39 3.4 - 4.0 marks Collect suitable data for your research. (4 marks) Suitable data have NOT Suitable data have been collected (that can be used in the experimentation) either downloaded from some sources or newly collected Several suitable datasets have been collected. Datasets are publicly available or reproducible (if synthetic). Datasets are commonly The datasets have been introduced and their At least one synthetic dataset has been created. The process of the synthetic dataPage 4 of 4 been collected. The answer is NOT easy to understand or has grammatical errors. (if necessary or useful for the research). If the data are newly collected then the purpose and process is clearly explained. The answer is easy to understand and without any grammatical errors. used (if downloaded) in the research community. If the data are newly collected then either it should be made public or if there is any restriction in disclosing the data its properties should be clearly presented. properties are well explained. Justifications for choosing the datasets have been provided. The answer is very well written. generation has been clearly and concisely presented. A justification of the synthetic data generation has been given. 0 - 1.99 2.0 - 2.59 2.6 - 2.99 3.0 - 3.39 3.4 - 4.0 marks Explain your experimental plan. (4 marks) A clear experimental plan is missing. The answer is NOT easy to understand or has grammatical errors. The experimental plan is clearly presented. The answer is easy to understand and without any grammatical errors. It lists the statistical parameters and tests that will be used to evaluate the proposed approach. The experimental plan names a few existing techniques that will be compared with the proposed technique. If there is no existing technique then one or two suitable techniques have been devised and presented. The significance of the experiment is clearly explained. The answer is very well written. Additional Comments: The standard outline for each criteria are cumulative. So, for example, to achieve the standard for High Distinction your work needs also to meet the standards outlined for Pass, Credit and Distinction.