Collaborators needed to develop a paper on research career structures

Eric Silverman (Southampton) is looking for collaborators who want to develop a paper on research career structures.  The paper will summarise some of the studies done so far on short-term research contracts and their effect on young researchers, particularly women.  The goal will be to identify the interacting factors which affect early-career academics who are trying to develop a career, and use this as a foundation for a modelling project in future.  Anyone who is interested should contact Eric at e.silverman@soton.ac.uk.

SSPOS resource list (data, tools etc.)

This is the list of resources contributed by workshop participants.

Data set [please add your name, name of data set, and references such as pointer to an archive, ....] 

• Scholarly Database at IU with 28M papers, patents, grants, clinical trials that can be cross searched. Datasets can be downloaded as dump in easy to process formats.

• Digging into Data Data Repository: http://www.diggingintodata.org/Repositories/tabid/167/Default.aspx

Data to mimic/factual evidence for beliefs and negotiation

• Stefan Thurner http://www.complex-systems.meduniwien.ac.at/people/sthurner/ this group set up an on-line game see http://www.nature.com/srep/2012/120614/srep00457/full/srep00457.html Stefan is member of Knowescape

• Twitter data of Filippo Menczer's  group http://cnets.indiana.edu/people/filippo-menczer/ 

• Conover, Michael. 2013. "Digital Democracy The Structure and Dynamics of Political Communication in a Large Scale Social Media Stream". Thesis 

Database of data sources

• Living archive: http://livingarchive.inn.ac/datasets/?tag=universities

Model tools you use [public such as NetLogo, Java library or tailor made]

• NWB, Sci2 and EpiC (http://cishell.org) provide a number of modelling algorithms. Sci2 is used/taught in the Information Visualization MOOC (http://ivmooc.cns.iu.edu)

• Peer review model in Jason from Grimaldo & Paolucci: http://www.openabm.org/model/4025/version/2/view

• Nicolas Payette NetLogo https://github.com/nicolaspayette/sspos 

• Stuart Rossiter: MASON as a programmer-friendly transparent Java ABM framework; AnyLogic as a user-focused, visual, multi-paradigm commercial tool (not just ABM); dabbled in Repast Simphony but find it a little too much of a half-way house; intending to use NetLogo more (unfairly branded a 'beginner's ABM tool' IMO) after some previous dabbling in StarLogo.

Data Sources for Models of Academic Careers

• NSF data sources on postdocs (US): http://www.nationalpostdoc.org/policy/543-nsf-data

• Higher Education Statistics Agency data on employees in HE (UK): http://www.hesa.ac.uk/index.php?option=com_content&task=view&id=1898&Itemid=239

• UCU Academic Staff Stress Survey results (UK): http://www.ucu.org.uk/workloadcampaign#demands

• UCEA Academic Workforce Survey 2013 (UK): http://www.ucea.ac.uk/en/publications/index.cfm/hews13

• NSF Microdata (US): http://nsf.gov/statistics/data-tools.cfm#micro-data

• Literature: http://www.sciencedirect.com/science/article/pii/S0169204611003550:

• Enengel,  B., Muhar, A., Penker, M., Freyer, B., Drlik, S., & Ritter, F.  (2011). Co-production of knowledge in transdisciplinary doctoral theses  on landscape development—An analysis of actor roles and knowledge types  in different research phases. Landscape and Urban Planning, 105,  106-117.     

Mailing List

You can subscribe to the mailing of the workshop by sending an email to:

sympa@sympa.ethz.ch

with the following text in the body of the email:

SUBSCRIBE ssps Your Name

(Example)

SUBSCRIBE ssps Stefano Balietti

To unsubscribe use:

SIGNOFF ssps

To send a message the the TO field is

ssps@sympa.ethz.ch

The mailing list is public at the moment, but it will be changed to moderated in the next days when enough people have subscribed.

Peer Review & Open Science

As discussed in the peer review group, the 'future of peer review' is strongly linked with movements towards open access and open science. Some references below which I (Stuart Rossiter) think are particularly good; feel free to comment / add more. (In particular, I think there is a baseline understanding of the landscape needed to avoid naïvely reinventing the wheel in certain ideas.)

Richard Poynder is an open access journalist / commentator with a great neutral viewpoint. His series of (long) interviews with prominent open access figures gives some great background to the people, ideas and progress. If you're interested in Open Access, follow him on Google+: he acts as a broadcast point for all OA developments (including criticisms from publishers, etc.).

Björn Brembs is particularly interesting for ideas on radical restructuring of publication, and Stevan Harnad for the original OA idea and a strong message on Green and Gold OA (see their interviews above). Brembs has also published some data-heavy critiques of journal rank, and his ideas relate to those of Martin Eve (a librarian).

Christopher Lee's Selected Papers Network (SPN) idea is very interesting, and his paper on it really captures all the nuances/problems of (journal) peer review (and as such is a good summary of the 'state of peer review' as well), and pre-empts all the 'yes, but...' questions for his idea. (Jan de Ruiter is also a big fan of this.) It also starts looking at the missing piece: how do reviewers get recognition/kudos for reviewing? Although it would be cool, he's not that  Christopher Lee :-)

For a concrete open peer review platform and journal, Pöschl has a paper about the platform for his ACP journal (which has been in place for some time).

In terms of open science more generally, the Science Code Manifesto is a good starting point (and the founding authors, especially Victoria Stodden, Cameron Neylon and Peter Suber).

Interesting References on Scarce Time Allocation and Science

Geard, Nic and Noble, Jason (2010) 'Modelling Academic Research Funding as a

Resource Allocation Problem', Proceedings of WCSS 2010 <http://eprints.soton.ac.uk/271374/7/fundingModel.pdf>.

Radner, Roy (1975) 'A Behavioural Model of Cost Reduction', Bell Journal of Economics, 6(1), Spring, pp. 196-215. 

A list of actions decided at the plenary session on the last day...

...along with those who agreed to (at least initially) coordinate them.  If you wish to help organise, contribute or be involved in any particular action, please contact the persons named.  News of these will also be posted here.

• A second SSPOS workshop, Valencia, Spain, in 2016 (jointly supported by PEERE and KnowEScape) -- Bulent Ozel, Francisco Grimaldo, Bruce Edmonds
• Peer Review Roadmap -- Francisco Grimaldo
• Relating/mapping models -- Edmund Chattoe-Brown
• Knowledge of available data sets -- Andrea Scharnhorst (via her list which I will post)
• List of Stylised Facts & Generative Mechanisms -- Christopher Watts
• List of Challenge problems -- Bruce Edmonds
• "SimScience" games -- Andre Martins
• Overview/position paper (PlosOne?) -- Stuart Rossiter, Bruce Edmonds
• Publication options in order of preference: JASSS, Frontiers, Scientometrics, Research Policy, Topics in Cognitive Science, Springer book -- Bruce Edmonds

André Martins' slides on "Theory Choice: Epistemic lessons from simple artificial agent models?"

at: http://cfpm.org/spos/lcw/Theory%20Choice2.pdf

Paul Thagard's slides on "Social Simulation of Scientific Creativity"

at: http://cfpm.org/spos/lcw/thagard.social-sim.leiden.ppt

Elena Tur's slides on "Diffusion of Scientific Knowledge: A Percolation Model"

At: http://cfpm.org/spos/lcw/Elena%20M%20Tur%20-%20Lorentz%20Center%20APR%202014.pptx

Bruce Edmonds' slides on "Belief Change via Social Influence and Explanatory Coherence"

At: http://cfpm.org/spos/lcw/Edmonds_Belief_Change_via_Social_Influence_and_%20Explanatory_Coherence_SPOS_LEIDEN_2014.pptx

Alexander Petersen's slides on "Quantifying the role of teamwork and reputation across scientific careers"

At: http://cfpm.org/spos/lcw/Petersen_Quantifying_Role_of_Teamwork_Leiden_2014.pdf

Ingo Scholtes' slides on "When your social position predicts your success: Lessons from Open Source communities and citations"

At: http://cfpm.org/spos/lcw/Scholtes_When_your_social_position_predicts_your_success_Leiden_2014.pdf

Loet Leydesdorff's slides on "Can the Socio-Cognitive Process of Science be Simulated?"

At: http://cfpm.org/spos/lcw/Leydesdorff_Can_Social_Processes_of_Science_be_Simulated_LorentzCenter.April14.pptx

Diego Garlaschelli's slides on "Reconciling long-term cultural diversity and short-term collective social behavior: an interdisciplinary challenge"

Reference: Valori et al., PNAS vol. 109, no. 4, pp. 1068-1073 (2012)

Slides at: http://cfpm.org/spos/lcw/Garlaschelli_Reconciling_2014_04_10%20Lorentz%20Center.pdf

Bülent Özel's slides on "A Multi-agent Simulation Model on Individual Cognitive Structures and Collaboration in Sciences"

At: http://cfpm.org/spos/lcw/Ozel_A%20Multi-agent_Simulation_Model_on_Individual_Cognitive_Structures_and_Collaboration_in_Sciences_SPOS2014.pdf

Simulating social processes of science mailing list

homepage
https://sympa.ethz.ch/sympa/info/ssps

SUBSCRIBE ssps Your Name

(Example)
SUBSCRIBE ssps Stefano Balietti

SIGNOFF ssps

Link to document about data sets and tools

https://hackpad.com/SSPoS-resource-list-CUcVelM17bP
To be used directly to share models, datasets

Group photo from workshop...

...Andre Martins, Elena Mas Tur and Ozul Bulent had not arrived by this point.

Slides from Francisco Grimaldo et al on "Mechanisms for science: Leasons learned from modeling peer review"

Mechanisms for science: Leasons learned from modeling peer review
Francisco Grimaldo, Juan Bautista Cabotà (U.València) Mario Paolucci (LABSS- ISTC- CNR)
Flaminio Squazzoni (GECS-U. Brescia)

Available at: http://cfpm.org/spos/lcw/Francisco%20Grimaldo%20Moreno%20et%20al%20P2014-SPOS.pdf

Brainstormed research questions for Interdisciplinarity Group

Brainstormed research questions for Interdisciplinarity Group

1. How do disciplines emerge/develop? (Foundational)
2. How can interdisciplinarity help/hinder in the search for knowledge?
3. Does successful interdisciplinary research lead to a new speciality?
4. What patterns of expectations lead to lead to success of interdisciplinary approaches? (management of interdisciplinary teams)
5. What constitutes a successful interdisciplinary project? (Foundational)
6. What is the impact of participating in interdisciplinary projects on early stage researchers?
7. What processes facilitate the appearance of interdisciplinary communications?
8. What are the respective roles of people, ideas, and institutions in the emergence of interdisciplinary research?
9. What are the challenges involved in doing interdisciplinary projects?
10. How do we identify disciplines? (Foundational)
11. How do new problems motivate/cause the emergence of new disciplines?

In answer to the question "How do we identify disciplines?" there were the following suggestions:

• Coherency of beliefs
• Similar tools, methods, and reference points
• Same Heroes
• Establishing milestones (a conference series, association, journal, summer school, phds etc)
• Inter-reading
• Specific markers (prizes, awards etc.)

Wednesday morning version of the timetable

	Monday	Tuesday	Wednesday	Thursday	Friday
Theme	Context, Positions and Approaches	Models and Underpinnings	Models and Applications	Applications, Open Questions, Directions  and Issues	What next?
9:00	Registration and Coffee	Mario Paolucci and Francisco Grimaldo: developing simulation models of peer review Alexander Petersen: Quantifying the role of teamwork and reputation	Ingo Scholtes: lessons from open source and citations Elena Mas Tur: Diffusion of scientific knowledge: a percolation model	Diego Garlaschelli: long-term cultural diversity and short-term collective behaviour Janusz Holyst: Information slows down hierarchy growth	Breakout groups: further initiatives and funding opportunities
10.00	Introduction to the Lorentz Centre
	Nicolas Payette: a survey of previous models
10.30		Coffee break	Coffee break	Coffee break	Coffee break
11.00	Invited Speaker: Katy Börner	Free discussion period around simulations	Free discussion period around simulations	Free discussion period around simulations	Invited Speaker: Paul Thagard
12.30	Lunch	Lunch	Lunch	Lunch	Farewell Lunch
14.00	Brief Introduction to the workshop by organisers	Bruce Edmonds:  incorporating cognitive dissonance with social influence Coffee break Free discussion period around simulations	Free discussion period or relaxation	Andre Martins: Theory Acceptance Bulent Ozel: Individual Cognitive Structures and Collaboration in Science	Possible extended discussions
	Poster Presentations of all participants
15.30	Coffee break			Coffee break
16.00 – 17.00	Frank Schweitzer: Beyond simulating science Loet Leydesdorff: The exchanges of expectations in scholarly discourse			Short presentations on arising issues from the discussions so far and Open Discussion
17.00 – 17.30		Plenary reports of discussions / developments
Evening	Welcome drinks		Social dinner

Workshop focus questions in order of judged level of interest....

Key Questions in rough order of interest (as judged by a quick show of hands by workshop participants):

• What data sources are there available to help text/develop simulations of scientific processes?
• How do the cognitive and social processes interact to develop collective knowledge?
• What do simulations suggest about the organisation of research?
• How can we progress our understanding of science using social simulation?
• How do the social processes contribute to the agreement/disagreement between groups of scientists? 
• Are there any cognitive "foundations" upon which to base social simulations of science?
• How is division of labour/specialisation self-organised in science?

Katy Borner's Slides on "Mulit Level Science Models"...

...from her invited talk today are available at:
   http://cns.iu.edu/docs/presentations/2014-borner-scimodeling-nl.pdf

Talks of Elena Mas Tur and Alexander Petersen are now swapped...

...since Elena will not be here until Wednesday.

Thus the timetable looks like this:

	Monday	Tuesday	Wednesday	Thursday	Friday
Theme	Context, Positions and Approaches	Models and Underpinnings	Models and Applications	Applications, Open Questions, Directions  and Issues	What next?
9:00	Registration and Coffee	Mario Paolucci and Francisco Grimaldo: developing simulation models of peer review Alexander Petersen: Quantifying the role of teamwork and reputation	Ingo Scholtes: lessons from open source and citations Elena Mas Tur: Diffusion of scientific knowledge: a percolation model	Diego Garlaschelli: long-term cultural diversity and short-term collective behaviour Janusz Holyst: Information slows down hierarchy growth	Breakout groups: further initiatives and funding opportunities
10.00	Introduction to the Lorentz Centre
	Nicolas Payette: a survey of previous models
10.30		Coffee break	Coffee break	Coffee break	Coffee break
11.00	Invited Speaker: Katy Börner	Free discussion period around simulations	Free discussion period around simulations	Short presentations on arising issues from the discussions so far	Invited Speaker: Paul Thagard
12.30	Lunch	Lunch	Lunch	Lunch	Farewell Lunch
14.00	Brief Introduction to the workshop by organisers	Andre Martins: Theory Acceptance Bruce Edmonds:  incorporating cognitive dissonance with social influence	Free discussion period or relaxation	Parallel group discussions on a selection of these issues	Possible extended discussions
	Poster Presentations of all participants
15.30	Coffee break	Coffee break		Coffee break
16.00 – 17.00	Frank Schweitzer: Beyond simulating science Loet Leydesdorff: The exchanges of expectations in scholarly discourse	Free discussion period around simulations		Plenary Reports from Groups and Open Discussion
17.00 – 17.30		Plenary reports of discussions / developments
Evening	Welcome drinks		Social dinner

A developing document of resources (data, tools) for simulating the social processes of science

Please add any computational tools, or sources of data useful for this topic:
    https://hackpad.com/SSPoS-resource-list-CUcVelM17bP

Nicolas Payette on "Agent-Based Models of Science: A Glimpse of the Past and Tools for the Future"

The introductory talk at the LC workshop. 

His slides are: http://cfpm.org/spos/lcw/sspos-nicolaspayette-expanded.pdf

Links for the Two papers mentioned by Kay Borner in her talk

The Simultaneous Evolution of Author and Paper Networks

Katy Börner, Jeegar T. Maru, Robert L. Goldstone

 

Available at: http://arxiv.org/abs/cond-mat/0311459

Collective allocation of science funding: from funding agencies to scientific agency

Johan Bollen, David Crandall, Damion Junk, Ying Ding, Katy Boerner

 

Available at: http://arxiv.org/abs/1304.1067

Most recent timetable for the Lorentz Workshop

	Monday	Tuesday	Wednesday	Thursday	Friday
Theme	Context, Positions and Approaches	Models and Underpinnings	Models and Applications	Applications, Open Questions, Directions  and Issues	What next?
9:00	Registration and Coffee	Mario Paolucci and Francisco Grimaldo: developing simulation models of peer review Elena Mas Tur: Diffusion of scientific knowledge: a percolation model	Ingo Scholtes: lessons from open source and citations Alexander Petersen: Quantifying the role of teamwork and reputation	Diego Garlaschelli: long-term cultural diversity and short-term collective behaviour Janusz Holyst: Information slows down hierarchy growth	Breakout groups: further initiatives and funding opportunities
10.00	Introduction to the Lorentz Centre
	Nicolas Payette: a survey of previous models
10.30		Coffee break	Coffee break	Coffee break	Coffee break
11.00	Invited Speaker: Katy Börner	Free discussion period around simulations	Free discussion period around simulations	Short presentations on arising issues from the discussions so far	Invited Speaker: Paul Thagard
12.30	Lunch	Lunch	Lunch	Lunch	Farewell Lunch
14.00	Brief Introduction to the workshop by organisers	Andre Martins: Theory Acceptance Bruce Edmonds:  incorporating cognitive dissonance with social influence	Free discussion period or relaxation	Parallel group discussions on a selection of these issues	Possible extended discussions
	Poster Presentations of all participants
15.30	Coffee break	Coffee break		Coffee break
16.00 – 17.00	Frank Schweitzer: Beyond simulating science Loet Leydesdorff: The exchanges of expectations in scholarly discourse	Free discussion period around simulations		Plenary Reports from Groups and Open Discussion
17.00 – 17.30		Plenary reports of discussions / developments
Evening	Welcome drinks		Social dinner