Tuesday, 29 April 2014

Collaborators needed to develop a paper on research career structures

Eric Silverman (Southampton) is looking for collaborators who want to develop a paper on research career structures.  The paper will summarise some of the studies done so far on short-term research contracts and their effect on young researchers, particularly women.  The goal will be to identify the interacting factors which affect early-career academics who are trying to develop a career, and use this as a foundation for a modelling project in future.  Anyone who is interested should contact Eric at e.silverman@soton.ac.uk.

Saturday, 12 April 2014

SSPOS resource list (data, tools etc.)

This is the list of resources contributed by workshop participants.

Data set [please add your name, name of data set, and references such as pointer to an archive, ....] 

  • Scholarly Database at IU with 28M papers, patents, grants, clinical trials that can be cross searched. Datasets can be downloaded as dump in easy to process formats.

Data to mimic/factual evidence for beliefs and negotiation
  • Conover, Michael. 2013. "Digital Democracy The Structure and Dynamics of Political Communication in a Large Scale Social Media Stream". Thesis 

Database of data sources

Model tools you use [public such as NetLogo, Java library or tailor made]

  • Stuart Rossiter: MASON as a programmer-friendly transparent Java ABM framework; AnyLogic as a user-focused, visual, multi-paradigm commercial tool (not just ABM); dabbled in Repast Simphony but find it a little too much of a half-way house; intending to use NetLogo more (unfairly branded a 'beginner's ABM tool' IMO) after some previous dabbling in StarLogo.

Data Sources for Models of Academic Careers
  • Enengel,  B., Muhar, A., Penker, M., Freyer, B., Drlik, S., & Ritter, F.  (2011). Co-production of knowledge in transdisciplinary doctoral theses  on landscape development—An analysis of actor roles and knowledge types  in different research phases. Landscape and Urban Planning, 105,  106-117.     

Mailing List

You can subscribe to the mailing of the workshop by sending an email to:

sympa@sympa.ethz.ch

with the following text in the body of the email:

SUBSCRIBE ssps Your Name

(Example)
SUBSCRIBE ssps Stefano Balietti

To unsubscribe use:

SIGNOFF ssps

To send a message the the TO field is

ssps@sympa.ethz.ch

The mailing list is public at the moment, but it will be changed to moderated in the next days when enough people have subscribed.

Peer Review & Open Science

As discussed in the peer review group, the 'future of peer review' is strongly linked with movements towards open access and open science. Some references below which I (Stuart Rossiter) think are particularly good; feel free to comment / add more. (In particular, I think there is a baseline understanding of the landscape needed to avoid naïvely reinventing the wheel in certain ideas.)

Richard Poynder is an open access journalist / commentator with a great neutral viewpoint. His series of (long) interviews with prominent open access figures gives some great background to the people, ideas and progress. If you're interested in Open Access, follow him on Google+: he acts as a broadcast point for all OA developments (including criticisms from publishers, etc.).

Björn Brembs is particularly interesting for ideas on radical restructuring of publication, and Stevan Harnad for the original OA idea and a strong message on Green and Gold OA (see their interviews above). Brembs has also published some data-heavy critiques of journal rank, and his ideas relate to those of Martin Eve (a librarian).

Christopher Lee's Selected Papers Network (SPN) idea is very interesting, and his paper on it really captures all the nuances/problems of (journal) peer review (and as such is a good summary of the 'state of peer review' as well), and pre-empts all the 'yes, but...' questions for his idea. (Jan de Ruiter is also a big fan of this.) It also starts looking at the missing piece: how do reviewers get recognition/kudos for reviewing? Although it would be cool, he's not that  Christopher Lee :-)


For a concrete open peer review platform and journal, Pöschl has a paper about the platform for his ACP journal (which has been in place for some time).

In terms of open science more generally, the Science Code Manifesto is a good starting point (and the founding authors, especially Victoria Stodden, Cameron Neylon and Peter Suber).

Interesting References on Scarce Time Allocation and Science

Geard, Nic and Noble, Jason (2010) 'Modelling Academic Research Funding as a
Resource Allocation Problem', Proceedings of WCSS 2010 <http://eprints.soton.ac.uk/271374/7/fundingModel.pdf>.

Radner, Roy (1975) 'A Behavioural Model of Cost Reduction', Bell Journal of Economics, 6(1), Spring, pp. 196-215. 

A list of actions decided at the plenary session on the last day...

...along with those who agreed to (at least initially) coordinate them.  If you wish to help organise, contribute or be involved in any particular action, please contact the persons named.  News of these will also be posted here.
  • A second SSPOS workshop, Valencia, Spain, in 2016 (jointly supported by PEERE and KnowEScape) -- Bulent Ozel, Francisco Grimaldo, Bruce Edmonds
  • Peer Review Roadmap -- Francisco Grimaldo
  • Relating/mapping models -- Edmund Chattoe-Brown
  • Knowledge of available data sets -- Andrea Scharnhorst (via her list which I will post)
  • List of Stylised Facts & Generative Mechanisms -- Christopher Watts
  • List of Challenge problems -- Bruce Edmonds
  • "SimScience" games -- Andre Martins
  • Overview/position paper (PlosOne?) -- Stuart Rossiter, Bruce Edmonds
  • Publication options in order of preference: JASSS, Frontiers, Scientometrics, Research Policy, Topics in Cognitive Science, Springer book -- Bruce Edmonds

Thursday, 10 April 2014

Bruce Edmonds' slides on "Belief Change via Social Influence and Explanatory Coherence"

At: http://cfpm.org/spos/lcw/Edmonds_Belief_Change_via_Social_Influence_and_%20Explanatory_Coherence_SPOS_LEIDEN_2014.pptx

Alexander Petersen's slides on "Quantifying the role of teamwork and reputation across scientific careers"

At: http://cfpm.org/spos/lcw/Petersen_Quantifying_Role_of_Teamwork_Leiden_2014.pdf

Ingo Scholtes' slides on "When your social position predicts your success: Lessons from Open Source communities and citations"

At: http://cfpm.org/spos/lcw/Scholtes_When_your_social_position_predicts_your_success_Leiden_2014.pdf

Loet Leydesdorff's slides on "Can the Socio-Cognitive Process of Science be Simulated?"

At: http://cfpm.org/spos/lcw/Leydesdorff_Can_Social_Processes_of_Science_be_Simulated_LorentzCenter.April14.pptx

Diego Garlaschelli's slides on "Reconciling long-term cultural diversity and short-term collective social behavior: an interdisciplinary challenge"

Reference: Valori et al., PNAS vol. 109, no. 4, pp. 1068-1073 (2012)

Slides at: http://cfpm.org/spos/lcw/Garlaschelli_Reconciling_2014_04_10%20Lorentz%20Center.pdf

Bülent Özel's slides on "A Multi-agent Simulation Model on Individual Cognitive Structures and Collaboration in Sciences"

At: http://cfpm.org/spos/lcw/Ozel_A%20Multi-agent_Simulation_Model_on_Individual_Cognitive_Structures_and_Collaboration_in_Sciences_SPOS2014.pdf

Wednesday, 9 April 2014

Simulating social processes of science mailing list

homepage
https://sympa.ethz.ch/sympa/info/ssps

SUBSCRIBE ssps Your Name

(Example)
SUBSCRIBE ssps Stefano Balietti

SIGNOFF ssps

Link to document about data sets and tools

https://hackpad.com/SSPoS-resource-list-CUcVelM17bP
To be used directly to share models, datasets

Group photo from workshop...

...Andre Martins, Elena Mas Tur and Ozul Bulent had not arrived by this point.


Slides from Francisco Grimaldo et al on "Mechanisms for science: Leasons learned from modeling peer review"

Mechanisms for science: Leasons learned from modeling peer review
Francisco Grimaldo, Juan Bautista Cabotà (U.València) Mario Paolucci (LABSS- ISTC- CNR)
Flaminio Squazzoni (GECS-U. Brescia)

Available at: http://cfpm.org/spos/lcw/Francisco%20Grimaldo%20Moreno%20et%20al%20P2014-SPOS.pdf

Brainstormed research questions for Interdisciplinarity Group

Brainstormed research questions for Interdisciplinarity Group

  1. How do disciplines emerge/develop? (Foundational)
  2. How can interdisciplinarity help/hinder in the search for knowledge?
  3. Does successful interdisciplinary research lead to a new speciality?
  4. What patterns of expectations lead to lead to success of interdisciplinary approaches? (management of interdisciplinary teams)
  5. What constitutes a successful interdisciplinary project? (Foundational)
  6. What is the impact of participating in interdisciplinary projects on early stage researchers?
  7. What processes facilitate the appearance of interdisciplinary communications?
  8. What are the respective roles of people, ideas, and institutions in the emergence of interdisciplinary research?
  9. What are the challenges involved in doing interdisciplinary projects?
  10. How do we identify disciplines? (Foundational)
  11. How do new problems motivate/cause the emergence of new disciplines?

In answer to the question "How do we identify disciplines?" there were the following suggestions:

  • Coherency of beliefs
  • Similar tools, methods, and reference points
  • Same Heroes
  • Establishing milestones (a conference series, association, journal, summer school, phds etc)
  • Inter-reading
  • Specific markers (prizes, awards etc.)

Tuesday, 8 April 2014

Wednesday morning version of the timetable


Monday
Tuesday
Wednesday
Thursday
Friday

Theme
Context, Positions and Approaches
Models and Underpinnings
Models and Applications
Applications, Open Questions, Directions  and Issues
What next?

9:00
Registration and Coffee
Mario Paolucci and Francisco Grimaldo: developing simulation models of peer review
Alexander Petersen: Quantifying the role of teamwork and reputation
Ingo Scholtes: lessons from open source and citations
Elena Mas Tur: Diffusion of scientific knowledge: a percolation model
Diego Garlaschelli: long-term cultural diversity and short-term collective behaviour
Janusz Holyst: Information slows down hierarchy growth
Breakout groups: further initiatives and funding opportunities

10.00
Introduction to the Lorentz Centre

Nicolas Payette: a survey of previous models

10.30
Coffee break
Coffee break
Coffee break
Coffee break

11.00
Invited Speaker: Katy Börner
Free discussion period around simulations
Free discussion period around simulations
Free discussion period around simulations
Invited Speaker: Paul Thagard

12.30
Lunch
Lunch
Lunch
Lunch
Farewell Lunch

14.00
Brief Introduction to the workshop by organisers
Bruce Edmonds:  incorporating cognitive dissonance with social influence

Coffee break

Free discussion period around simulations
Free discussion period or relaxation
Andre Martins: Theory Acceptance
Bulent Ozel: Individual Cognitive
Structures and Collaboration in Science
Possible extended discussions

Poster Presentations of all participants

15.30
Coffee break
Coffee break

16.00 –
17.00
Frank Schweitzer: Beyond simulating science
Loet Leydesdorff: The exchanges of expectations in scholarly discourse
Short presentations on arising issues from the discussions so far and Open Discussion

17.00 – 17.30
Plenary reports of discussions / developments

Evening
Welcome drinks

Social dinner


Workshop focus questions in order of judged level of interest....

Key Questions in rough order of interest (as judged by a quick show of hands by workshop participants):
  • What data sources are there available to help text/develop simulations of scientific processes?
  • How do the cognitive and social processes interact to develop collective knowledge?
  • What do simulations suggest about the organisation of research?
  • How can we progress our understanding of science using social simulation?
  • How do the social processes contribute to the agreement/disagreement between groups of scientists? 
  • Are there any cognitive "foundations" upon which to base social simulations of science?
  • How is division of labour/specialisation self-organised in science?

Monday, 7 April 2014

Katy Borner's Slides on "Mulit Level Science Models"...

...from her invited talk today are available at:
   http://cns.iu.edu/docs/presentations/2014-borner-scimodeling-nl.pdf

Talks of Elena Mas Tur and Alexander Petersen are now swapped...

...since Elena will not be here until Wednesday.

Thus the timetable looks like this:


Monday
Tuesday
Wednesday
Thursday
Friday

Theme
Context, Positions and Approaches
Models and Underpinnings
Models and Applications
Applications, Open Questions, Directions  and Issues
What next?

9:00
Registration and Coffee
Mario Paolucci and Francisco Grimaldo: developing simulation models of peer review
Alexander Petersen: Quantifying the role of teamwork and reputation
Ingo Scholtes: lessons from open source and citations
Elena Mas Tur: Diffusion of scientific knowledge: a percolation model
Diego Garlaschelli: long-term cultural diversity and short-term collective behaviour
Janusz Holyst: Information slows down hierarchy growth
Breakout groups: further initiatives and funding opportunities

10.00
Introduction to the Lorentz Centre

Nicolas Payette: a survey of previous models

10.30
Coffee break
Coffee break
Coffee break
Coffee break

11.00
Invited Speaker: Katy Börner
Free discussion period around simulations
Free discussion period around simulations
Short presentations on arising issues from the discussions so far
Invited Speaker: Paul Thagard

12.30
Lunch
Lunch
Lunch
Lunch
Farewell Lunch

14.00
Brief Introduction to the workshop by organisers
Andre Martins: Theory Acceptance
Bruce Edmonds:  incorporating cognitive dissonance with social influence
Free discussion period or relaxation
Parallel group discussions on a selection of these issues
Possible extended discussions

Poster Presentations of all participants

15.30
Coffee break
Coffee break
Coffee break

16.00 –
17.00
Frank Schweitzer: Beyond simulating science
Loet Leydesdorff: The exchanges of expectations in scholarly discourse
Free discussion period around simulations
Plenary Reports from Groups and Open Discussion

17.00 – 17.30
Plenary reports of discussions / developments

Evening
Welcome drinks

Social dinner



A developing document of resources (data, tools) for simulating the social processes of science

Please add any computational tools, or sources of data useful for this topic:
    https://hackpad.com/SSPoS-resource-list-CUcVelM17bP

Nicolas Payette on "Agent-Based Models of Science: A Glimpse of the Past and Tools for the Future"

The introductory talk at the LC workshop. 

His slides are: http://cfpm.org/spos/lcw/sspos-nicolaspayette-expanded.pdf

Links for the Two papers mentioned by Kay Borner in her talk

The Simultaneous Evolution of Author and Paper Networks

 

Collective allocation of science funding: from funding agencies to scientific agency

 

Most recent timetable for the Lorentz Workshop



Monday
Tuesday
Wednesday
Thursday
Friday

Theme
Context, Positions and Approaches
Models and Underpinnings
Models and Applications
Applications, Open Questions, Directions  and Issues
What next?

9:00
Registration and Coffee
Mario Paolucci and Francisco Grimaldo: developing simulation models of peer review
Elena Mas Tur: Diffusion of scientific knowledge: a percolation model
Ingo Scholtes: lessons from open source and citations
Alexander Petersen: Quantifying the role of teamwork and reputation
Diego Garlaschelli: long-term cultural diversity and short-term collective behaviour
Janusz Holyst: Information slows down hierarchy growth
Breakout groups: further initiatives and funding opportunities

10.00
Introduction to the Lorentz Centre

Nicolas Payette: a survey of previous models

10.30
Coffee break
Coffee break
Coffee break
Coffee break

11.00
Invited Speaker: Katy Börner
Free discussion period around simulations
Free discussion period around simulations
Short presentations on arising issues from the discussions so far
Invited Speaker: Paul Thagard

12.30
Lunch
Lunch
Lunch
Lunch
Farewell Lunch

14.00
Brief Introduction to the workshop by organisers
Andre Martins: Theory Acceptance
Bruce Edmonds:  incorporating cognitive dissonance with social influence
Free discussion period or relaxation
Parallel group discussions on a selection of these issues
Possible extended discussions

Poster Presentations of all participants

15.30
Coffee break
Coffee break
Coffee break

16.00 –
17.00
Frank Schweitzer: Beyond simulating science
Loet Leydesdorff: The exchanges of expectations in scholarly discourse
Free discussion period around simulations
Plenary Reports from Groups and Open Discussion

17.00 – 17.30
Plenary reports of discussions / developments

Evening
Welcome drinks

Social dinner