Group: IPERNITY - Ambassador Images

1. Specification

The assessment of the proposed pictures should make as little work as possible for the administrators as well as for the jury. Nevertheless, it should deliver a well-differentiated, solid result - even with only a few jury members.

2. Proprietary solution

Ipernity offers the possibility to rate images with asterisks. This simple solution would do the least work. Unfortunately, it is useless because the proposed pictures are already pre-rated by other members. Other tools are not offered by ipernity. One would have to painstakingly improvise them, which would be labour-intensive for all involved.

3. Third-party services

3a. An attempt was made to perform the voting with the help of Discord. In terms of preparing, this is acceptable because the pictures can be linked directly from ipernity. However, counting is labour-intensive and error-prone. Moreover, DISCORD - like ipernity - only allows simple yes/no ratings. This leads to little differentiated results with few judges. More differentiated solutions would have to be laboriously improvised, which would not be adequate.

3b. Therefore, we were looking for a service that specialised in online photo competitions. With Poll Unit we found a service that fully meets our requirements. You can find a detailed description of the options here:

English: pollunit.com/en/photo-contest
French: pollunit.com/fr/concours-photographique
German: pollunit.com/de/fotowettbewerb

The following possibilities are particularly interesting for us:
● Execution of more differentiated votings (exactly tailored to our needs).
● Anonymisation of the image suggestions (avoidance of prejudice).
● Randomisation of the image proposals (avoidance of systematic errors).
● Anonymisation of the evaluation (no mutual influence of the jurors).
● Automated evaluation (saving of work).
● Easy documentation of the results (enables transparency for the proposers too).

The PRO version of this service costs 3 euros per month by subscription. Tests were successful. It was subscribed for 1 year in order to gain further practical experience.

Disadvantage: The preparations are more time-consuming because no direct linking of the pictures is possible. The pictures must therefore first be downloaded from the user accounts and then uploaded to Poll Unit. The latter can be done very easily as a batch process via Poll Unit's upload wizard. But the download from ipernity causes problems. Many members have blocked this option. This is perfectly correct. It is not to be influenced.

Solution: A general technical release of the download for the group administrators would require an intervention in the ipernity software, as well as a change in the terms of use. However, taking screenshots is permitted because this is publicly accessible content. This method will therefore be used until further notice. The HD image quality is completely sufficient for the application purpose.

4. Further procedure

For the time being, jury voting should be done with Poll Unit. The ima team has agreed. Bergfex is to develop a workflow for taking the screenshots that saves as much work as possible. He should document it here in due course.

5. Assessment method

Until further notice, the jury will vote with up to 5 stars ⭐⭐⭐⭐⭐ per picture. This results in an average number of stars per picture. Abstentions will not be taken into account in determining this value.

Example: 9 jurors score (with one abstention and two absences due to holidays) as follows:
┃ ⭐⭐⭐ ┃ ⭐⭐ ┃ ⭐⭐⭐⭐ ┃ ▬ ┃ ⭐⭐⭐ ┃ ⭐⭐ ┃ ⭐⭐⭐ ┃ ▬ ┃ ▬ ┃
The result is: 17 / 6 = 2.83

After the end of a voting, the scores will be listed in rank order by Poll Unit. This list can be made public for the information of the submitters. This might enhance transparency and acceptance. Of course, the voting of the jurors should remain secret.

....................................................................................................................................


edit:

5a. The assessment method has been improved in the meantime. See: comment below

5b. Members of the editorial team can get a large display of the photos to be able to assess them better. To do so, simply click on the first picture. You can even get a full-screen view. There is a special icon for this at the bottom right of the display. You can use the arrow keys on the keyboard to scroll forwards or backwards. This way you can comfortably move through all the photos and vote without leaving the full screen mode.

5c. NOT awarding a picture is equivalent to abstaining.

5d. Members of the editorial team can sort the pictures according to their personal scoring. This way they can check their vote at any time and readjust it if necessary until the end of the assessment period.