Citizendium Forums
July 24, 2008, 11:02:55 AM *
Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
News: The WatchKnow Board is for general public discussion of WatchKnow issues.  You need not be a Citizendium member to participate on this board. 
Click here to return to WatchKnow home page
 
   Home   Help Search Login Register  
Pages: [1] 2 3 ... 5
  Print  
Author Topic: The CZ article approval process: RFC (revised)  (Read 15157 times)
Larry Sanger
Administrator
Forum Regular
****
Posts: 1421



WWW
« on: December 10, 2006, 02:28:36 PM »

To settle upon an approval process, we have to determine two things: what the technical procedure will be whereby an article is marked as "approved," and what people and process will actually result in so marking an article.

=====

I. The technical procedure of approval.

We may choose among at least three procedures for approving articles:


(1) (This option would require that we wait for several weeks or months.)  Code, or adapt, a mediawiki plugin that will display the latest approved version, if available, or otherwise the latest unapproved version.


(2) Place an approval template

   http://pilot.citizendium.org/wiki/Template:Approved_Article

at the top of an article, which links to an uneditable version in the page history.  In this case, if an approved version were available, users would have to click through to it.


(3) "Protect" articles that have been approved, and move ongoing article development to a subpage.  For example, the editor-approved version of the "Citizendium" article would live at this URL:

   http://pilot.citizendium.org/index.php/Citizendium

while the currently-developed version of the article would live at this url:

   http://pilot.citizendium.org/index.php/Citizendium/draft

As a result, the most recently approved version of the article would be the version displayed to users, while participants could still work on the article in a "draft" subpage.


Of these three procedures, it appears to me that (1) and (2) can each be ruled out.  (1) is unacceptable because we have editors who are chomping at the bit ready to start approving articles.  For several of our editors, this is a high priority and it cannot wait for software work that might or might not be coming.  (2) is also unacceptable because it contradicts I.3. of the Statement of Fundamental Policies: "If an 'approved' or 'certified' version of an article is available, that version will be presented to the public by default; in that case, viewing unapproved versions will require further mouseclicks for the public, and such versions will be clearly labelled as unapproved, and users will be instructed not to rely upon them."

Perhaps I am not thinking of some other possibilities, but if we are limited to (1)-(3), then we must go with (3).  That's my tentative conclusion, subject as always to feedback from everyone.  This then brings us to the next main issue, which is *how* articles will be approved.


=====


II. The approval process.

Our Statement of Fundamental Policies also says this: "Among the things that editors will be empowered, singly or collectively, to do are...(2) to approve high-quality articles.  Editors will not have the right, except perhaps in very unusual cases, to 'lock' articles and thereby prevent the collaborative process from continuing."  Note that option (3) above does not prevent collaboration from continuing, because it can continue on the "draft" subpage.

There is virtually nothing about the approval process in the current version of the "Policy Outline" document, although there are some useful details on a new page, here:

   http://pilot.citizendium.org/wiki/Citizendium_Pilot:Approval_Process

It seems to me that there are only a few salient questions that inform the shape of the process.  They include (but probably are not limited to):

(a) The approval of how many editors is required for a version of an article to be approved?

(b) If more than one person must be involved, through what means do they cooperate and come to a joint decision?  Vote, for example, or nomination and seconding?

(c) What mechanism, if any, is used to determine if a person has editorial license to approve a particular article?

(d) Should editors be able to approve articles on which they have worked very much?

(e) Once it is decided, somehow, that an article is to be approved, what happens after that in order to get the approved version marked as approved?

Here then is my proposal, and I hope as always that you will feel free to comment at length and plug for something different.  As you know, I do change my mind (sometimes with frightening frequency) and always try to keep an open mind about nearly everything.

As to (a), I think that the approval of just one editor should suffice.  There are several reasons for this.  First, the added requirement of more editors complicates the process not additively but multiplicatively.  I will elaborate this point in more detail if necessary, but one thing I will make explicit is that it is extremely important, if we are to remain competitive and dynamic, that every aspect of our process remain efficient.

Second, the counter-argument is, obviously, that editors working alone can be grossly mistaken, whereas the chance for error greatly decreases with the addition of just one more expert.  I have two answers to this argument, namely that the perfect is the enemy of the good, and that there will be plenty of oversight.  As to oversight, an editor will not be able to approve on which he or she as worked much; furthermore I propose that we ought not to begin approving articles until there is some minimum number of editors in a given workgroup.

As to (b), while only one editor is needed to approve an article, editors might well want to *consult* with others.  Moreover, another editor may revoke the approval of an article, or (pre-emptively) declare that he or she will revoke the approval if it is approved.  BECAUSE OF THIS FACT (which I shout out because it's so darn important, you know :-) ), while approval may be done by individuals, the *effect* is that it will be done by groups.

Clarified.  In addition, I think that an article about topic T in workgroup W should be approvable only if W has >n editors; we can debate about n, but I suggest n=5, i.e., a half dozen or more editors are needed in a workgroup before any article assigned to that workgroup can be approved.  The reason for requiring that number of editors is that, in any group, it's likely that over half of the editors listed won't be paying attention.  The hope, actually, is that if there are six editors in a group, then two of them might be paying attention.  This, together with general oversight by non-editors of that workgroup, should be an adequate check against editors approving bunches of stuff that shouldn't be approved.  Actually, in some cases it still might not be an adequate check; but this whole enterprise is based on trust, organically-developing patterns, and probabilities.

Clarified.  As to (c), I have no special suggestions here.  We specify (as we have already done in many places) that a person must be a specialist on the topic of the article to be approved.  One *indicator* of this is that the article is assigned to a workgroup in which a person is an editor.  But this doesn't even rise to the level of a rule.  For all I know, for instance, Russell Potter can be considered an expert on Arctic exploration, although he is listed as a Literature Editor and not in History or Earth Sciences.  (He did, after all, edit the Encyclopedia of the Arctic.)  And there are many people who are qualified to be editors of, say, Biology, but who lack sufficient expertise to approve of most of all articles assigned to the Biology workgroup.

Beyond this guideline (i.e., that only experts on topic T can approve articles on T), which we will have to codify more carefully of course, I think we will simply have to rely on oversight by everyone, editors and authors alike, to report questionable cases to the relevant workgroup.  And as to what workgroups do with questionable cases, well, we haven't faced that problem yet so we haven't worked out the policy yet.  But, again, we will have to codify a policy on that.

Amended.  As to (d), the answer is No, for the simple reason that individuals are too often poor judges of the merits of their own work.  In particular, they often think it's better than it really is.  But we may make an exception in the case where there are three or more editors (who are qualified to approve the article) at work on an article.  Then any of those editors may approve it, with the expectation that the others will provide adequate oversight of the decision.

Amended/simplified.  As to (e), I propose we begin the following process:

(i) On the article's talk page, an editor declares that the article is ready to approve, and waits for a response.  At the same time, the editor places a template of this form {{approve|group=W|date=yyyymmdd|url=URL}} on the article's talk page.  E.g., {{approve|group=Biology|date=20061220|url=http://pilot.citizendium.org/wiki?title=Biology&oldid=100011126}} .  W is the workgroup name.  The date given should always be the day after tomorrow, i.e., it will be no less than 24 hours away and no more than 48 hours.  However, the date may be today's date if there has been much discussion among at least three editors capable of approving the article, and there is a clear consensus among them.  Note that the URL points to a precise version found in the article history (note that the current version of every article does have a stable URL locatable in the page history).  The {{approve}} template should automatically place the article in a category such as [[Category:W Articles to Approve]].

(ii) When the date listed arrives, then a sysop (i.e., anyone with sysop rights, meaning any constable or personnel administrator) copies the approved version from the history to the main namespace article page, places an "{{approved}}" template at the top of the article, protects the article, and finally moves the current version to a /draft page (example above).  Finally, the sysop removes the {{approve}} template from the talk page (thereby removing it from that queue).  Done!

To update an approved article, the procedure is the same, except that the sysop doesn't touch the working copy on the /draft page.

=====

Note, the above concerns the approval *process*.  It doesn't touch the question of approval *standards*.  Those standards are outlined here:
   http://tinyurl.com/yevu93

NOTE that I have, earlier today, added a new standard: "Integrated. Articles must be coherent, unified, and integrated. An integrated article is written according to a single coherent and appropriate plan and in a single style. An unintegrated article appears to have been written by different people or at different times, or with different conceptions about the article's proper structure and style. Typically, an unintegrated article repeats information pointlessly and leaves out crucial information where an expert would expect to find it."

Written with compliments to Nancy Sculerati.

--Larry
Logged

My CZ user page: http://en.citizendium.org/wiki/User:Larry_Sanger
Please link to your CZ user page in your signature, too!
To do that, click on Profile > Forum Profile Information.
Larry Sanger
Administrator
Forum Regular
****
Posts: 1421



WWW
« Reply #1 on: December 10, 2006, 02:31:53 PM »

The above is a revised version.  I've closed the earlier topic and opened this new one.
Logged

My CZ user page: http://en.citizendium.org/wiki/User:Larry_Sanger
Please link to your CZ user page in your signature, too!
To do that, click on Profile > Forum Profile Information.
David Tribe
Forum Communicator
***
Posts: 122


« Reply #2 on: December 10, 2006, 03:03:08 PM »

seems good, and keeps it simple, workable and transparent. As long as we have a process that enables a lockdown of the approved default version fairly soon
cheers David
Logged

My User page  where you will find more:

"http://pilot.citizendium.org/wiki/User:David_Tribe"

but more useful is my talk page:

"http://pilot.citizendium.org/wiki/User_talk:David_Tribe"

See you there
 :0)
Supten
New Arrival
*
Posts: 21



WWW
« Reply #3 on: December 10, 2006, 10:35:01 PM »

The outline of the policy seems to be OK. Once we actually start the process of approving articles, newer problems may come up and we can cross the bridge when it comes. However, still most of the category of editors do not have a sufficient(?) number of listed names. -Supten
Logged

Anthony.Sebastian
Forum Participant
**
Posts: 111


Good prose is like a windowpane. -- George Orwell


WWW
« Reply #4 on: December 10, 2006, 10:36:13 PM »

Not to quibble, but to assert an opinion:

I would name the new standard: Coherent.  To integrate implies bringing the parts together, without necessarily any sense of coherence, style or grace.  To cohere implies a consistent relation of the parts, logically, stylistically, and aesthetically.  The integrated parts cohere.

Standard Coherent: The parts of a coherent article should relate consistently in an orderly, logical, stylistically aesthetic manner. An incoherent article appears written by different people or at different times, or with different conceptions about the article's proper structure and style. Typically, an incoherent article repeats information pointlessly and leaves out crucial information where an expert would expect to find it."
Logged

Derek Harkness
Forum Regular
****
Posts: 527


« Reply #5 on: December 11, 2006, 03:49:17 AM »

Ditto Anthony. The words 'integrated article' when I first read them brought me to thinking about merging articles or creating summery articles that integrate several sections of different articles into one whole. The correct words to match the description given would be either, as Anthony suggested 'Coherent' or else 'homogeneous'.

Quote
Actually, in some cases it still might not be an adequate check; but this whole enterprise is based on trust, organically-developing patterns, and probabilities.
Editor-Editor oversight requirements are reduced due to having Author-Editor oversight. If an editor went about approving 'bunches of stuff that shouldn't be approved' then there should be a protocol for Authors and Editors alike to whistle call. While a Author can't intervene directly to unapprove, the author can alert another editor or constable to potential problems. So if a workgroup has few editors but lots of authors, then the editors should be allowed to approve articles. The question is how many authors makes critical mass and how many authors = an editor in this mass equation?

(d) To touch on a point made on the old thread by Nancy - Larry uses the words 'worked very much'. Editors who's contribution to an article was to comment on the talk page are only acting as editors, not as authors. I would expect an Editor to pass comments on the talk page prior to starting the approval discussion. Also, minor edits to grammar, punctuation and layout would not constitute 'worked very much'. I'd say very much would only come into play if a factual change had been made, not just tweeking  some typos.
Logged

Zachary Pruckowski
Technical Liasion/Executive Committee
Administrator
Forum Regular
****
Posts: 935


« Reply #6 on: December 11, 2006, 11:32:47 AM »

(d) To touch on a point made on the old thread by Nancy - Larry uses the words 'worked very much'. Editors who's contribution to an article was to comment on the talk page are only acting as editors, not as authors. I would expect an Editor to pass comments on the talk page prior to starting the approval discussion. Also, minor edits to grammar, punctuation and layout would not constitute 'worked very much'. I'd say very much would only come into play if a factual change had been made, not just tweeking  some typos.

The purpose of the provision appears to be blocking "stealth of night" approvals, where an editor writes an article, then approves it with little or no discussion.  What if we say that an editors may not approve a page if he (or she) "is the only editor to have worked on the page in the last two weeks, or if he has contributed 1/3 or more of the changes".  That way, on articles with only an editor and a few authors, the editor can't approve the page without some peer review.  And it stops any two-editor group from pushing their way around.  That also avoids hindering an article like "biology" where 3 or more editors are already actively working on it.
Logged

Larry Sanger
Administrator
Forum Regular
****
Posts: 1421



WWW
« Reply #7 on: December 12, 2006, 09:03:24 PM »

The first article approved according to this process is the "Biology" article:

http://pilot.citizendium.org/wiki/Biology

The nomination was by Nancy Sculerati, with Gareth Leng and David Tribe concurring.  My understanding is that Dr. Sculerati did much of the writing, and it is really an excellent article, a wonderful replacement for the relatively unreadable and pedantic Wikipedia article.  As I told the contributors on the talk page:

"This is an amazingly well-written article. It does not attempt to introduce every aspect of biology equally, but by being selective--focusing on the definition and scope of biology, and then surveying its main areas via its history--it does provide exactly what is wanted from an encyclopedia article about biology, namely, a general introduction that conveys a rough general understanding. A survey of the main areas--alphabetically, say--would convey more information about those areas, but would very probably not do nearly as good a job at introducing biology as a whole. So, thanks, folks, for helping prove the viability of the general premise behind CZ."

So, according to the proposed approval process, described here,

http://forum.citizendium.org/index.php/topic,331.0.html

in lieu of a single editor approving an article of which he or she is not a main author, any set of three or more editors may approve a version of the article, even if they are all major authors of it.  The latter condition was met, so I went ahead and did a whole series of things:

(1) I created the {{ToApprove}} template.  You can see an example on

http://pilot.citizendium.org/wiki/Talk:Biology

But bear in mind that according to the rules, since the article has actually been approved, I should have removed that template.  Well, I *will* remove it, but I'm just leaving it up there for you to get a look at it.

(2) I created the {{Approved}} template.  You can see this at:

http://pilot.citizendium.org/wiki/Biology

(3) Note, as part of the above two templates, I created [[Category:{{{group}}} Approved]] and [[Category:{{{group}}} to Approve]].  In other words, there are now categories containing all the biology articles-to-approve, and all the biology articles that have been approved.  Here:

http://pilot.citizendium.org/wiki/Category:Biology_to_Approve
http://pilot.citizendium.org/wiki/Category:Biology_Approved

(Again, there shouldn't be anything in the former category now, but I'm just leaving the article there as an illustration.)

(4) Since the above categories are useful to look at when one is looking at a workgroup, I've gone ahead and added two new columns to the workgroups table:

http://pilot.citizendium.org/wiki/Citizendium_Pilot:Discipline_Workgroups

Note for mediawiki dweebs: most of the links in the new columns are red.  If you want to help out by making them blue, use these templates:

{{ToApprove cat|group=XYZ}}
{{Approved cat|group=XYZ}}

You might also cleverly make the relevant categories subcategories of (new) master "Approved Articles" and "Articles to Approve" categories.  (I had to leave *something* for you to do. :-) )

(5) I moved the most recent version of the article to a /Draft page:

http://pilot.citizendium.org/wiki/Biology/Draft

Note, this is not a true subpage, so we must hand-link back to the main page.  We can't really have true subpages if we want to be backwards-compatible with Wikipedia, which permits articles like [[Face/Off]] that are not subpages of [[Face]].  This is OK because as a technical solution, the /Draft procedure is intended to be temporary anyway.  (Erg, but how temporary?)

(6) I placed the {{Approved}} template at the top of

http://pilot.citizendium.org/wiki/Biology

And then pasted in the version of the article that was pointed to in the {{ToApprove}} template on the biology talk page.

(7) Finally, as I happen to be a sysop, I then protected the main page article.

Note, *I* won't be doing all this most of the time.  I expect editors themselves to use the {{ToApprove}} and {{Approved}} templates, as appropriate, and other sysops (I think there are a half dozen of us) to protect the main pages as needed.

I'll have to write up instructions for both editors and sysops--unless, of course, someone else would like to do me a favor and do that!

We are still open to comments on this whole process, here:

http://forum.citizendium.org/index.php/topic,331.0.html

--Larry
Logged

My CZ user page: http://en.citizendium.org/wiki/User:Larry_Sanger
Please link to your CZ user page in your signature, too!
To do that, click on Profile > Forum Profile Information.
Chris Day
Forum Regular
****
Posts: 632


« Reply #8 on: December 13, 2006, 12:09:18 AM »

One comment.  I expected the approval template to be a bit smaller. At present it dominates the top of the page.  Is that desirable?  Its probably ok for the online version, but is there a way for it to be hidden when printing it?
Logged

Zachary Pruckowski
Technical Liasion/Executive Committee
Administrator
Forum Regular
****
Posts: 935


« Reply #9 on: December 13, 2006, 01:11:17 AM »

You may want to remove the disclaimer template, since we already have a disclaimer in the approval template.  (And we want to be able to eventually get rid of that, as far as I'm concerned)
Logged

Larry Sanger
Administrator
Forum Regular
****
Posts: 1421



WWW
« Reply #10 on: December 13, 2006, 01:30:02 AM »

Right, the disclaimer shouldn't appear on approved pages--but I wonder if we can possible make that happen?
Logged

My CZ user page: http://en.citizendium.org/wiki/User:Larry_Sanger
Please link to your CZ user page in your signature, too!
To do that, click on Profile > Forum Profile Information.
Zachary Pruckowski
Technical Liasion/Executive Committee
Administrator
Forum Regular
****
Posts: 935


« Reply #11 on: December 13, 2006, 02:03:46 AM »

Note for mediawiki dweebs: most of the links in the new columns are red.  If you want to help out by making them blue, use these templates:

{{ToApprove cat|group=XYZ}}
{{Approved cat|group=XYZ}}

You might also cleverly make the relevant categories subcategories of (new) master "Approved Articles" and "Articles to Approve" categories.  (I had to leave *something* for you to do. :-) )

I just did all of that, and used <noinclude> to add the categories to the pages (but not the templates to the categories).

I think I'm done?  If I missed something, someone else can do it.  I'm done with exams and going to bed!
Logged

Pedro S
New Arrival
*
Posts: 5


« Reply #12 on: December 13, 2006, 05:19:27 AM »

I'm sorry if my question seems silly: with the new {{ToApprove}} templates, what happened to the 3-editors rule?... For example, may I stick the template on an Article I have written, or should I put a "request for approval" on its tal page?
Logged
David Tribe
Forum Communicator
***
Posts: 122


« Reply #13 on: December 13, 2006, 05:20:34 AM »

Having just got involved in a second approval I take on board Larry comments about it becomming more dynamic. I have learned by doing (and making mistakes) but next few approvals the efficiency will rise five fold each time. The reason why there is so many questions and clumsyness (at least for me)  is weve never done it befoer but after three approvals we'll all move very much more smoothly.

Can I point out that the approval template thingo should (best) go on the TALK page not the main article. For me its much easier to follow whats happening

We should maybe make it a standard  procedure to drop a link URL  to the event approval notice linking from the work group forum, unless  there a better place for the editors to do this
Logged

My User page  where you will find more:

"http://pilot.citizendium.org/wiki/User:David_Tribe"

but more useful is my talk page:

"http://pilot.citizendium.org/wiki/User_talk:David_Tribe"

See you there
 :0)
David Tribe
Forum Communicator
***
Posts: 122


« Reply #14 on: December 13, 2006, 05:23:04 AM »

I'm sorry if my question seems silly: with the new {{ToApprove}} templates, what happened to the 3-editors rule?... For example, may I stick the template on an Article I have written, or should I put a "request for approval" on its tal page?


What I did is air the issue on thw work group forum and waited till three editors has (more or less) said yes, but my article was uncontrovesial as it started out very good as a feature article at wiki.
Logged

My User page  where you will find more:

"http://pilot.citizendium.org/wiki/User:David_Tribe"

but more useful is my talk page:

"http://pilot.citizendium.org/wiki/User_talk:David_Tribe"

See you there
 :0)
Pages: [1] 2 3 ... 5
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.4 | SMF © 2006-2007, Simple Machines LLC Valid XHTML 1.0! Valid CSS!