SURVEY:SUMMARY:BUILD_DIFFICULTY[not_applicable, reasonable_effort, code_problematic or string] reasonable_effort
SURVEY:SUMMARY:CLASSIFICATION[practical,theoretical,hardware] practical
SURVEY:SUMMARY:CORRECT_CODE_LOCATION[string] 
SURVEY:SUMMARY:PUBLISHED_CODE[not_applicable, yes, no] yes
SURVEY:SUMMARY:SAME_VERSION[not_applicable, yes, no_but_available, no_and_not_available] yes
SURVEY:SUMMARY:STUDY_FOUND_CORRECT_CODE[not_applicable, yes, no] yes
SURVEY:AUTHOR1:BUILD_COMMENT[string] you recieved: g++: error: ControlThread.cpp: No such file or directory<br/><br/>this was due to a minor bug<br/>this file was simply not needed. All you had to do<br/>and what any competant programmer imho would do<br/>is delete this dependency from the make-file and see if it compiles (and it does, and we also fixed right away).<br/><br/>Or ask us by mail.. but you didn't. and obviously you had no problem finding our mail. Absurd. We used code of others many times, often dealing with much much more serious issues without giving it a second thought.
SURVEY:AUTHOR1:BUILD_DIFFICULTY[not_applicable, reasonable_effort, code_problematic or string] reasonable_effort
SURVEY:AUTHOR1:BUILD_DIFFICULTY_COMMENT[string] 
SURVEY:AUTHOR1:CLASSIFICATION[practical,theoretical,hardware] practical
SURVEY:AUTHOR1:CLASSIFICATION_COMMENT[string] 
SURVEY:AUTHOR1:CORRECT_CODE_LOCATION[string] 
SURVEY:AUTHOR1:PUBLIC_COMMENT[string] Your `validation process' is, frankly, absurd and therefore provides useless results. <br/><br/>In our case<br/>the version we posted had unnecessary dependency (file) in makefile, all you had to do is follow the error message and remove it and all would work fine- or ask us by mail<br/>you did neither. <br/><br/>Besides, you only checked that projects compile; what exactly does it mean that the project compiles? to really check reproducibility you must validate it by running and comparing results and functionality. Your `test` would pass a an "hello, world!" program... absurd. You wasted more time for us in understanding your useless `evaluation` and writing such response as this, than you invested in evaluating our project. A waste of time.
SURVEY:AUTHOR1:PUBLISHED_CODE[not_applicable, yes, no] yes
SURVEY:AUTHOR1:SAME_VERSION[not_applicable, yes, no_but_available, no_and_not_available] yes
SURVEY:AUTHOR1:SAME_VERSION_COMMENT[string] 
SURVEY:AUTHOR1:STUDY_FOUND_CORRECT_CODE[not_applicable, yes, no] yes