To your very first year’s articles study, 16 children (10 female, six men) regarding local colleges supported as coders; throughout the second 12 months, 13 programmers (8 girls, 5 guys) who had been often newest people otherwise current graduates held the new blogs coding. Half a dozen of programmers handled both blogs analyses. The newest levels out of coder studies incorporated positioning on programming activity and you will codebook, large group coding off reveals beyond the decide to try with supervisors, and finally personal coding from behavior reveals in which programmers examined shows physically and chatted about the outcomes period by the period inside weekly conferences. Initial reliability analyses was in fact used for the studies gathered from inside the personal routine stage of training to decide when coders you can expect to go ahead that have the actual programming task. The brand new precision analyses exhibited less than, not, get in touch with tests off coder arrangement taken from the fresh new coding out of a subset off suggests throughout the system products.
Programmers watched sequential 2-second intervals regarding system time and coded brand new presence otherwise lack regarding intimate choices and you will mention sex associated with nonheterosexuals. Just like the coding try confined so you can program posts and omitted ads or any other promotions, coders utilized cooking area timers plus the surfaces towards videocassette recorders to trace 2-time menstruation off program time. Programmers registered study with the scannable variations each interval while they viewed they. Though coders was permitted to bring advice pass (i.age., fool around with suggestions demonstrated inside the earlier menstruation to learn the content from inside the later on ones), these were perhaps not permitted to code in reverse (i.age., have fun with suggestions discovered later on within the an application to return and you can change the coding into the an early period). Every opening loans and those closure credits accompanied by articles out of the current episode (i.elizabeth., a final scene) had been coded.
Approximately eleven in order to 12% of your own suggests regarding the system samples (letter = 157 and n = 154 to your first and you can next blogs analyses, respectively) was basically at random allotted to several coders to have separate coding and you can precision evaluation. Immediately after one another coders’ data was recorded and you can assessed for precision aim, the brand new coders then found to answer any discrepancies from the one or two categories of product reviews and produce a final set of reviews for the newest show that was used into the studies analyses of the whole system take to. Investigations off reliability is used on the a continuous basis from the cuatro to 5 months it took programmers to complete the entire system decide to try each year. Software out of each and every category each community variety of have been included in this new precision analyses. Types was basically portrayed about double-coded trials from inside the estimate proportion on the representation about overall program trials.
Having purposes of accuracy comparison, the amount of 2-moment durations coded per variable pertaining to intimate minorities are summed across the menstruation in an event in order to ge-intercourse intimate conclusion and you can talk about nonheterosexual intimate situations occurred contained in this each system occurrence. This summing triggered converting nominal data (we.elizabeth., presence/absence) in the dos-minute-period top to the volume matters at program height (quantity of periods in which exact same-sex intimate behavior occurred in new event). Thus, the new accuracy analyses utilized the Intraclass Correlation Coefficient (ICC). The fresh ICC is a review of one’s proportion off variance into the the newest strategies owing to coder contract corrected to own chance. For period studies like the frequency matters utilized right here, the ICC matches Krippendorf’s alpha (Krippendorf, 1980).
An ICC from .70 was applied once the standard to have acceptable accuracy. This new ICC having exact same-sex sexual choices is actually .97 inside 
season step 1 and you will .99 from inside the season 2. The fresh new ICC having speak about nonheterosexual sexual situations try .89 during the seasons step one and you can .95 in 12 months 2.
