Morality Website Collaboration

From PsychWiki - A Collaborative Psychology Wiki

(Difference between revisions)
Jump to: navigation, search
Jhaidt (Talk | contribs)
(Content - Registration/demographics)
Ravi (Talk | contribs)
Line 5: Line 5:
YourMorals.org (with yourmorals.com redirecting to that site)...
YourMorals.org (with yourmorals.com redirecting to that site)...
-
== Home Page ==
+
== Marketing ideas (Getting Traffic) ==
-
What should the home page look like?  I think they should be able to get to the tests quickly like on Tickle.com....but I do like the more scientific nature of Project Implicit's home page. Do we want to appeal to the consumer masses or to the more serious minded?
+
* I think it will be easy to direct traffic to our site. I do a few radio and magazine interviews every month, and can just mention the site once its up. And my happiness hypothesis page gets 60 unique visitors a day, from all over the world. I can put a link on the front page, we should get a few a day from that. And if the site is rewarding, it will spread by word of mouth.--Jon
 +
* Adwords Campaign?
-
* https://implicit.harvard.edu/implicit/research/
 
-
* http://web.tickle.com/
 
-
http://moral.wjh.harvard.edu/index2.html [Marc hauser's site]
 
-
I like how at https://implicit.harvard.edu/implicit/ you have the option of going directly to tasks on the demonstration site, or you can sign up for the research site. I think this registration feature is well worth emulating, as this will allow us to randomly assign participants in specific studies (along with collecting lots of anonymous data via the demo site). When people register, they enter all their demographic info; one obvious benefit is that we'd have their politics (and race, age, etc.) info from a previous time, so in a study we won't have to directly ask them and prime that identity.
 
-
[jon]The real value for us will come from people taking multiple tests. Or at least giving us some basic demographic info, plus a single test. So I think we want to insist that everyone register, and tell us their sex, age, native language, what country they are in, what country they were raised in, and a few questions about politics and religion. Then we can send them on to one or more tests. This will discourage many people who are just playing around, but i don't think it's bad to lose such people. We will be so glad to have that demographic info later on.  So I think we should have a welcome screen, modeled after the Hauser site. Then for anyone who proceeds, a login screen that gives people the chance to create a new login, or to sign in with their old ID and password. Then send them on to a test-launching screen, which shows the available tests, and which ones they have already taken, along with their scores, when relevant.
 
-
Here is a great, simple example of a positive psychology site:
 
-
http://swbresearch.netfirms.com/index.html
 
-
can we start by just modeling ourselves on this site? We could use a logo, or header. Scales of justice are a bit trite, and are already used by Hauser. Perhaps a whole set of morally loaded symbols: cross, star of david, crescent, scales, atom, donkey, elephant.... the idea being to convey that there are so many moral systems out there....
 
-
 
-
I like the idea of modeling it on the swb site.  That has a nice layout -- where you can create an account (where we can get background info), sign up to participate in ongoing studies (I REALLY want the ability to do experiments and here is where we can have one or a few going at any one time), and also sign up for email notifications about new studies (this is a really nice feature).  I assume we have to ability to keep responses tied to account names over time, which will allow us to not only tie demographics/political ideology data to other study data collected later, but also to do longitudinal studies (test-retest data as well as more interesting longitudinal stuff, etc.)-- Pete
 
-
 
-
I guess a key issue is how "serious" we want this whole thing to appear.  Hauser's website and the IAT site are very serious with a research feel.  At the other end, Sam Gosling does stuff like induces people to complete personality scales by promising to tell them which character is their "Star Wars Twin" (not sure WHO that brings in -- my apologies to any star wars fanatics in the bunch).  I prefer a serious feel, but one that has hooks to bring people in -- to motivate them to complete scales in bite-size chunks and keeps them coming back for more.  We want people to register and give us some background info (and some way to tie their responses together), but we want this not to be too onerous so as to scare off people -- Pete
 
-
 
-
How does one start to draw people onto a site like this?  Can we link to other sites?  Advertise?  Is it just building word of mouth? -- Pete
 
-
 
-
I agree with Pete, we want this to look professional while still being inviting. Not silly or humorous. I think it will be easy to direct traffic to our site. I do a few radio and magazine interviews every month, and can just mention the site once its up. And my happiness hypothesis page gets 60 unique visitors a day, from all over the world. I can put a link on the front page, we should get a few a day from that. And if the site is rewarding, it will spread by word of mouth.--Jon
 
-
 
-
== Design/color scheme ==
 
-
 
-
What should the basic layout look like?  Color scheme?
 
-
 
-
[jon]I prefer simple and highly readable. I think a white background, with blue and black as the dominant colors?
 
-
 
-
I like simple too -- but a warmer background than white might be better.  I am tempted to say that it doesn't matter much, but Norbert Schwarz has done some work showing that certain colors of paper are associated with more or less systematic thought.  Probably doesn't account for much variance, but I have a student who was really into using this as a manipulation a while back -- I will get him to track down the papers and see if it is anything we need to worry about (or manipulate!  I, like many others, am really interested in the role of system 1 vs. system 2 thinking in moral reasoning) -- Pete
 
-
 
-
Wow, it sounds like color is relevant. But I'm a big believer in just getting something up for starters. It's much easier to plan and design when we have something in front of us. So, Ravi, I'd say just put up something simple with dark letters on a white background, and over the next month or two we'll improve it before we go live. --Jon
 
-
 
-
== Content - Registration/demographics ==
 
-
CHANGES TO MAKE ON THE EXISTING "CREATE AN ACCOUNT" PAGE
 
-
 
-
* can we indent the sub questions, e.g., "if no, what is" or "if your religion is not listed...." You can put a few dots, and then make the dots be in white color, so they don't show up.
 
-
* after email, add text: "We will never give your email out to anyone. We will not email you for any reason. We just want you to have a unique password"
 
-
* For education: add an option for "currently in high school".
 
 +
== Content - Questions to add somewhere==
ADDITIONAL QUESTIONS WE MIGHT ASK:
ADDITIONAL QUESTIONS WE MIGHT ASK:
Line 82: Line 51:
*Protecting large budgets for police departments
*Protecting large budgets for police departments
-
== Content - Questionnares ==
 
-
CHANGES TO MAKE TO EXISTING PAGE: "EXPLORE YOUR MORALS"
 
-
* fix schwartz link
 
-
* when they take a Q, don't show the navigation bars at the top. it's too tempting to leave. Just have a blank top, or perhaps a button that says "quit this survey" in the upper right. [jon]
 
-
TEXT TO PUT INTO "ABOUT THIS SITE"
 
-
This website is a collaboration among several social psychologists who study morality and politics. Our goal was to create a site that would be useful and interesting to users, particularly ethics classes and seminars, and that would also allow us to test a variety of theories about moral psychology. One of our main research goals is to help foster understanding across the political spectrum. Almost everyone cares about morality, and we want to understand the many different ways that people care.
 
-
The studies on this site [will be] approved by the Institutional Review Board at the University of Virginia.
+
== OTHER SCALES WE MIGHT ADD ==
-
 
+
-
To learn more about moral psychology, you can find articles we have written on our web pages (below).
+
-
If you have questions or comments about this site, please contact Ravi Iyer.
+
-
If you have questions or comments about the scales, or about moral psychology, please contact Jonathan Haidt or Pete Ditto.  [Dont make any of these names into clickable links; that makes it too easy, and also lures spam bots. Just spell out mine and pete's email addresses below, as "haidt at virginia.edu")
+
-
 
+
-
We thank you for your interest and your contribution to psychological research.
+
-
[put all our names here, along with web pages and email for anyone who wants to list. Mine is:
+
-
 
+
-
http://people.virginia.edu/~jdh6n/
+
-
 
+
-
We hope that it is useful for individuals ethics classes,
+
-
 
+
-
 
+
-
OTHER SCALES WE MIGHT ADD
+
Please add any scales/questions that you would like to add here...I'm not familiar with what legal issues there are in using certain scales...
Please add any scales/questions that you would like to add here...I'm not familiar with what legal issues there are in using certain scales...
Line 114: Line 63:
* More traditional Kohlbergian moral reasoning questionnaires
* More traditional Kohlbergian moral reasoning questionnaires
* The Disgust Scale - Revised (25 items)
* The Disgust Scale - Revised (25 items)
-
 
+
* I think moral dilemmas are really engaging for people, and might help draw people into the site.  There are of course the trolley & footbridge problems and Jon's classic ones (sex with a chicken).  I also have a series of scenarios that were developed by Tom Gilovich and Bob Frank at Cornell that are designed as a scale of a propensity toward consequentialist vs. deontological thought.  These kinds of scales can be more than fun diversions of course.  I use dilemmas that then manipulate certain aspects of them to examine how motivations affect moral judgments.  They can be stuck into a series of other scenarios to provide cover.  The other scenarios can also serve as baseline measures (e.g., of a tendency toward consequentialism) or as other dvs.  That is, one of tools we are using now to examine the motivated recruitment of moral principles is to look at "carry-over" effects.  If we induce people to rely a certain kind of principle to support a desired judgment, their reliance on the principle "carries over" to other judgments (e.g., if we induce people to get more consequentialist on one judgment, they are more consequentialist on subsequent judgments as well.  Bottom line -- I think scenarios (in addition to scales) are fun and terribly useful -- Pete
-
 
+
-
We also need to think about how we can present the feedback to people so that it keeps them coming back and referring others.  So for any scale that you wish to add, you'll need to come up with some kind of feedback text/system.
+
-
 
+
-
 
+
-
I think moral dilemmas are really engaging for people, and might help draw people into the site.  There are of course the trolley & footbridge problems and Jon's classic ones (sex with a chicken).  I also have a series of scenarios that were developed by Tom Gilovich and Bob Frank at Cornell that are designed as a scale of a propensity toward consequentialist vs. deontological thought.  These kinds of scales can be more than fun diversions of course.  I use dilemmas that then manipulate certain aspects of them to examine how motivations affect moral judgments.  They can be stuck into a series of other scenarios to provide cover.  The other scenarios can also serve as baseline measures (e.g., of a tendency toward consequentialism) or as other dvs.  That is, one of tools we are using now to examine the motivated recruitment of moral principles is to look at "carry-over" effects.  If we induce people to rely a certain kind of principle to support a desired judgment, their reliance on the principle "carries over" to other judgments (e.g., if we induce people to get more consequentialist on one judgment, they are more consequentialist on subsequent judgments as well.  Bottom line -- I think scenarios (in addition to scales) are fun and terribly useful -- Pete
+
== Other Ideas ==
== Other Ideas ==
Line 138: Line 82:
Sounds good =) [Sena]
Sounds good =) [Sena]
 +
 +
== How to submit a scale to the site? ==
 +
 +
So that you guys have a bit more control and I don't have to be so much of a gatekeeper to adding your studies, here are some guidelines for submitting your own surveys/studies....
 +
 +
=== The Basics ===
 +
 +
Your survey/study will be a collection of text files that you'll email me.  It could be as few as 2 files for a single survey and feedback page...or it could be more if you want to have participants go through multiple pages. 
 +
 +
=== Filenames ===
 +
 +
Make your filename relatively unique and descriptive.  Your feedback page should be the name of your firstpage plus "_process".  In addition all filenames should end in ".php".  So for example, the Schwartz scale has 2 files, "schwartz.php" and "schwartz_process.php".
 +
 +
=== Headers ===
 +
 +
At the top of every study page should be this snippet of text which will take care of validating the user, collecting any data submitted from previous pages, etc...
 +
 +
<?
 +
include "studytop.php";
 +
?>
 +
 +
At the top of your final feedback page should be this snippet....
 +
<?
 +
include "feedbacktop.php";
 +
?>
 +
 +
=== The Form Tag ===
 +
 +
After the header for study pages (not the feedback page) should be this form tag...
 +
 +
<form action="NEXTPAGE.php" method=post><?
 +
 +
NEXTPAGE should be the page that you want to go to next.  For single page studies/surveys, make that page the name of your feedback page.  If you are doing a mutiple page study, each page should name the successive page in place of NEXTPAGE.
 +
 +
=== Defining Question Format ===
 +
 +
You need to add the following 4 lines to define your scale.
 +
 +
$scalename = '5f'; <- name of your scale...it will show up in your SPSS data file..it should be different for each page
 +
$scaletype = '7pt'; <- define how many points your questions will have
 +
$scalebegin = 'not at all relevant'; <- beginning scale endpoint
 +
$scaleend = 'extremely relevant'; <- end scale endpoint
 +
 +
=== Defining Questions ===
 +
 +
For each question, add a line like this to your file...
 +
 +
addtoquestions('Whether or not someone believed in astrology');
 +
 +
If you want, you can define custom endpoints for a particular column by adding more information to this line...
 +
 +
An example...
 +
addtoquestions('Whether or not someone believed in astrology', 'Not Relevant!', 'Extremely Relevant!');
 +
 +
Add as many questions as you wish.
 +
 +
=== Display Instructions ===
 +
 +
Add this next to your file...
 +
 +
?>
 +
INSTRUCTIONS TEXT
 +
<?
 +
 +
Your INSTRUCTIONS TEXT should be in html if possible.  You can use frontpage, dreamweaver or even microsoft word and cut/paste the relevant parts in if you want.  Or you can write text and then replace all carriage returns with <br> and add "&nbsp;" wherever you want to add a space.  Enclose anything you want bold in <b> and end it with </b>.  I'm happy to clean this up for you or help you with it.
 +
 +
=== Display Questions ===
 +
 +
Add this to display questions
 +
 +
showallquestions(1);
 +
 +
The number 1 in parentheses will display questions in the order you put them in the file.  If you put a "0" in the parentheses, the code will randomize the order of questions.
 +
 +
=== Page Footer ===
 +
 +
Add this to finish your page....
 +
 +
showfooter("BUTTON TEXT");
 +
?>
 +
 +
Replace BUTTON TEXT with whatever you want your submit button to say.  For example, maybe you want it to say "See your results" and have your page go to the feedback page.  Or "Continue" if your page goes to another part of the study.

Revision as of 01:57, 11 April 2007

This is a page where we can collaboratively come up with ideas for a consumer oriented morality website....

Contents

Domain name

YourMorals.org (with yourmorals.com redirecting to that site)...

Marketing ideas (Getting Traffic)





Content - Questions to add somewhere

ADDITIONAL QUESTIONS WE MIGHT ASK:



We MIGHT also collect




OTHER SCALES WE MIGHT ADD

Please add any scales/questions that you would like to add here...I'm not familiar with what legal issues there are in using certain scales...

Other Ideas

We don't have to have just simple surveys....we could do some experiments as well and see how 5F and other moral measures correlate with other experiments. Personally, I'm interested in seeing how they correlate with intergroup and political attitude change.

[jon]Absolutely! Jesse and I are interested in whether political persuasion (support for policies and candidates) can be increased by matching foundations used in an appeal to the foundations endorsed by the listener. We definitely want the ability to do experiments. Perhaps we should have a list of scales, from which we rarely or never remove anything, so that people can always come back and see their scores, and can have the sense that they have completed all the scales. But we also have a page of experiments where we give them a debriefing right after, but otherwise don't tell them their specific results.

Legal details, etc.

Just to avoid any possible future hassles, we may want to think about who 'owns' or gets to publish whatever data we collect. Is the site open to all morality researchers to collect data? Perhaps Project Implicit provides a good model for these potentially sticky issues?

[jon]For the first year or two, i think it should just be a collaboration among the 5 of us. It will be hard enough to manage, and to get enough traffic to satisfy all our research fantasies. We also don't have a grant, as project implicit does. Perhaps in the future we could look into doing that. And perhaps we could "vote" to admit a few new members into our collaboration. But unless we have a full time programmer and administrator, I think we should just keep it simple.

[Jon] As for authorship: I think our general spirit should be (and is likely to be) cooperative without being fully communal. That is, I don't think we should assume that every study run here is a joint venture that all 5 of us would be authors on. But on the other hand, to the extent that any of us make more of a contribution than just offering advice at the early stage, that person would become a co-author. If Ravi is doing most of the work to help us all collect data, then Ravi might be in a position to deserve authorship credit more often, especially for our early projects. I want to be sure that everyone benefits from this collaboration, especially the grad students who have more of a rush need to get authorships. I think what's likely to happen is that we'll each put up a few studies more or less separately, and then find that it makes sense to write a manuscript that combines multiple studies. Or Pete or I will be invited to write a theory paper or review paper, for which it makes sense for us all to work together. So I expect that we'll see many joint-authored projects. But each of us should feel free to put up a simple questionnaire or study without feeling that doing so automatically invites co-authors. What do y'all think?

Jon has it exactly right here I think. I don't think we have to assume that everyone is part of everything that goes on on the site. Like any other research endeavor, it should depend on whether people contribute to projects, intellectually and/or logistically. In this sense I also think that Ravi might end up on more things than others, given his crucial technological role. I don't suspect any of this will be a problem with this group -- and ideally, of course, this kind of joint site will promote a lot of discussion and collaboration. We will have to figure out a way to pick and choose what is up on the site -- as I suspect it only makes sense to have a small number of project front and center at any one time. I don't have a good sense for how a website for this works -- how much can be up and available at once to maximize efficient data collection -- but we will have to sort this out -- Pete

Sounds good =) [Sena]

How to submit a scale to the site?

So that you guys have a bit more control and I don't have to be so much of a gatekeeper to adding your studies, here are some guidelines for submitting your own surveys/studies....

The Basics

Your survey/study will be a collection of text files that you'll email me. It could be as few as 2 files for a single survey and feedback page...or it could be more if you want to have participants go through multiple pages.

Filenames

Make your filename relatively unique and descriptive. Your feedback page should be the name of your firstpage plus "_process". In addition all filenames should end in ".php". So for example, the Schwartz scale has 2 files, "schwartz.php" and "schwartz_process.php".

Headers

At the top of every study page should be this snippet of text which will take care of validating the user, collecting any data submitted from previous pages, etc...

<? include "studytop.php"; ?>

At the top of your final feedback page should be this snippet.... <? include "feedbacktop.php"; ?>

The Form Tag

After the header for study pages (not the feedback page) should be this form tag...

<form action="NEXTPAGE.php" method=post><?

NEXTPAGE should be the page that you want to go to next. For single page studies/surveys, make that page the name of your feedback page. If you are doing a mutiple page study, each page should name the successive page in place of NEXTPAGE.

Defining Question Format

You need to add the following 4 lines to define your scale.

$scalename = '5f'; <- name of your scale...it will show up in your SPSS data file..it should be different for each page $scaletype = '7pt'; <- define how many points your questions will have $scalebegin = 'not at all relevant'; <- beginning scale endpoint $scaleend = 'extremely relevant'; <- end scale endpoint

Defining Questions

For each question, add a line like this to your file...

addtoquestions('Whether or not someone believed in astrology');

If you want, you can define custom endpoints for a particular column by adding more information to this line...

An example... addtoquestions('Whether or not someone believed in astrology', 'Not Relevant!', 'Extremely Relevant!');

Add as many questions as you wish.

Display Instructions

Add this next to your file...

?> INSTRUCTIONS TEXT <?

Your INSTRUCTIONS TEXT should be in html if possible. You can use frontpage, dreamweaver or even microsoft word and cut/paste the relevant parts in if you want. Or you can write text and then replace all carriage returns with
and add " " wherever you want to add a space. Enclose anything you want bold in and end it with . I'm happy to clean this up for you or help you with it.

Display Questions

Add this to display questions

showallquestions(1);

The number 1 in parentheses will display questions in the order you put them in the file. If you put a "0" in the parentheses, the code will randomize the order of questions.

Page Footer

Add this to finish your page....

showfooter("BUTTON TEXT"); ?>

Replace BUTTON TEXT with whatever you want your submit button to say. For example, maybe you want it to say "See your results" and have your page go to the feedback page. Or "Continue" if your page goes to another part of the study.

Personal tools
Namespaces
Variants
Actions
Navigation
Interaction
Toolbox