How to cite this article: Antonio Barrera-Cruz A, Arturo Viniegra-Osorio A, Valenzuela-Flores AA, Torres-Arreola LP, Dávila-Torres J. Methodology for the development and update of practice guidelines: current state. Rev Med Inst Mex Seguro Soc. 2016;54(1):78-91.
CLINICAL PRACTICE GUIDELINES
Received: November 28th 2014
Accepted: December 16th 2014
Antonio Barrera-Cruz,a Arturo Viniegra-Osorio,a Adriana Abigail Valenzuela-Flores,a Laura del Pilar Torres-Arreola,a Javier Dávila-Torresa
aCoordinación Técnica de Excelencia Clínica, Instituto Mexicano del Seguro Social, Distrito Federal, México
Communication with: Laura del Pilar Torres-Arreola
Thelephone: (55) 5584 5134
Email: lauratorresster@gmail.com
The current scenario of health services in Mexico reveals as a priority the implementation of strategies that allow us to better respond to the needs and expectations of individuals and society as a whole, through the provision of efficient and effective alternatives for the prevention, diagnosis and treatment of diseases. In this context, clinical practice guidelines constitute an element of management in the health care system, whose objective is to establish a national bechmark for encouraging clinical and management decision making, based on recommendations from the best available evidence, in order to contribute to the quality and effectiveness of health care. The purpose of this document is to show the methodology used for the development and updating of clinical practice guidelines that the Instituto Mexicano del Seguro Social has developed in line with the sectorial model in order to serve the user of these guidelines.
Keywords: Development and update; Health planning; Strategies; Practice guidelines as topic.
The current scenario of health services in Mexico reveals as a priority the implementation of strategies that allow us to better respond to the needs and expectations of individuals and society as a whole, through the provision of efficient and effective alternatives for the prevention, diagnosis, and treatment of diseases. In this context, clinical practice guidelines constitute an element of management in the health care system, whose objective is to establish a national benchmark for encouraging clinical and management decision making, based on recommendations from the best available evidence, in order to contribute to the quality and effectiveness of health care.
In our country, the Sistema Nacional de Salud has made significant advances that have been reflected in a strengthening of the coverage of health services, a reduction in the rate of infant mortality, and increased life expectancy of the population. However, challenges remain to be overcome, including facilitating access to health services and providing effective comprehensive care with quality, warmth, and security for the benefit of the patient and their family.
The Strategic Project for the Development, Implementation, and Evaluation of CPGs was designed in the Instituto Mexicano del Seguro Social (IMSS) to contribute to the updating of medical practice and the development of CPGs, with the identification of best practices and the efficient use of resources for health, so that the integrated action of the three levels of care can be located, to implement the project transversely to all disciplines involved in the care of the most common and urgent ailments.1,2
On the other hand, it should be noted that in the Institute, as part of CPG dissemination, implementation, and evaluation activities done in medical units throughout the country, the clinical practice guidelines and care protocols are used to provide clinical care (QPS.2.1 quality and patient safety, in our context adapted as Quality and Patient Safety Improvement),3 in accordance with the hospital certification standards, specifically the standards focusing on QPS management for the purpose of helping the standardization process of care, risk reduction, efficient resource use, providing timely and effective care, by implementing at least one guide, guideline, or clinical path per year using a methodological process.
Health professionals must daily make multiple and complex care decisions in which they wield the ability to identify the most suitable alternative by assessing the implications in terms of clinical outcomes, appropriateness, risks, costs, and social and individual impact.
The complexity of this decision process is exacerbated by the increased care opportunities and options arising from the advancement of scientific knowledge, the inability to assimilate all available scientific information, and the rationalization of health resources, altogether with the variability of clinical practice styles.4
CPGs are "informational documents including recommendations to optimize patient care, based on a systematic review of the evidence and the evaluation of the benefits and harms of different options in health care".5
The fundamental intention with the development of CPGs is to optimize health care to identify the most effective options for patient care in order to harmonize clinical decisions.6,7 Their quality and usefulness have been positively correlated with the productivity of the group that produces them.8,9
Appropriately developing CPGs involves making sure that they are valid, reproducible, reliable, applicable, and clear, besides being developed by an interdisciplinary group involved in all stages of the process.10,11
The purpose of this document is to show, in line with the sector model, the methodology used for the development and updating of CPGs developed by IMSS, so this document will serve the guide user as a starting point to understand and support of their use.
For the development and updating of CPGs, a mixed adaptation-adoption methodology was used in topics where the CPGs published by recognized international organizations responded to questions and covered the quality criteria defined by the instrument Appraisal of Guidelines Research and Evaluation II (AGREE II) (Table I).12
Table I Structure and content of AGREE * (Appraisal of Guidelines Research and Evaluation) | ||
Structure and content | Questions | Areas |
The general objectives of the guide are specifically described |
1-3 | General purpose of the guide, specific clinical questions, and target patient population |
Participation of stakeholders | 4-7 | Degree to which the guide represents the views of users at whom it is aimed |
Rigor in preparation | 8-14 | Process used to collect and synthesize the evidence, the methods to formulate recommendations and to update them |
Clarity and presentation | 15-18 | Language and format of the guide |
Applicability | 19-21 | Possible implications of the application of the guide in aspects of organization, behavior, and costs |
Editorial independence | 22-23 | Independence of the recommendations and recognition of possible conflicts of interest by the guide development group |
*Adapted from The AGREE Collaboration. |
Adapting a guide has been defined as the systematic method by which changes are made to the recommendations to suit the context in which the guide is to be used. Adapting a high quality CPG aims to take advantage of an existing guide in order to make the development efficient without undermining the validity of the resulting recommendations. The adaptation of a CPG is an alternative for the development of guidelines to respond to a need in each context; this way, we make sure to reduce the duplication of effort, in addition to making the creation process more efficient and possibly an element that promotes adherence to the recommendations.13,14
The adaptation process is based on the following grounds:
Stages for CPG development
The first step in CPG development is to identify the need for its construction, given the magnitude of the problem and variability in clinical practice, as well as costs of care. At this stage the working group is formed with clinical experts and methodologists necessary for the CPG’s development. After forming the group, a work plan is defined for each member of the team, including the development of the CPG under techniques systematized by consensus, clinical questions to be answered by the guide, giving priority to issues that have variability in clinical practice, aspects of direct impact on morbidity, new techniques and treatments, and what was considered improvable in patient care. Algorithm 1 shows the main elements to be considered in the process of CPG adaptation or development.
Algorithm 1 Steps for developing a CPG
Structured clinical questions
In daily practice, the need for information for decision making is a fundamental aspect that requires formulating correctly (in the form of questions) our clinical questions, and using complete sources of information effectively and efficiently. This process is facilitated by the practice of evidence-based medicine (EBM), which has been defined by Sackett15 as "the conscientious, explicit, and judicious use of the best current evidence in making decisions about patient care". This is a methodology of critical analysis and study of the scientific literature that gives value to both clinical experience and the certainty of information on the health care of people.
The convert the need for information into a structured clinical question, one must be aware of what is known and what is not known, as well as the knowledge that needs to be initiated, updated, or reinforced. In other words, we need to identify information needs. Without any doubt, structured clinical questions and the correct development of clinical recommendations are two of the pillars of this process.
Type of questions
Clinical questions can be classified by their character as general, specific, and by their nature as: etiology, prevention, diagnosis, treatment, and prognosis.
General or basic questions, with appropriate formal structure, generally have two essential components:
In other circumstances, our question may be greater and may affect the decision-making process in a particular patient. This is the case of specific questions also known as "first line," which require the person formulating them to have prior knowledge, as they are more complex and require a structure, as will be detailed later.16,17
Another way to classify the type of questions more directly related to the specific clinical situation is by dividing them into two groups:18
Transforming information needs into a structured clinical question (PICO format: patient, intervention, comparison, outcome) and dividing it into its components allows one to plan the most efficient search strategy by facilitating the process of choosing key terms to be used in the search. Selecting words from the first two components of the question reveals relevant articles in most cases.19
The structured clinical question is made up of three or four components:
The advantage of formulating specific clinical questions with the PICO format is unambiguously defining what one wants to know and helping to do the literature search, because there is a type of study design able to answer each type of question.
Updating CPGs
Progress in scientific knowledge and its constant evolution, and the emergence of new studies and results regarding best practices make it necessary for CPG to be subjected to a renewal process in order to maintain the validity and quality of its recommendations.
Updating a CPG is understood as a process that aims to maintain the validity of the recommendations made therein. Studies mention that the deadline for considering a CPG obsolete is three to five years, so the update should be done after that period. However, in some cases the update can be made before the end of the time limit.
Despite its usefulness, the lifetime of the CPG is limited due to the rapid advancement of clinical evidence on which recommendations are based. The emergence of new evidence after its production can make the recommendations weak when a critical and reflective analysis of the available scientific literature was not made at the moment of its creation.20
This can lead to missteps that go unnoticed by professionals, patients, and decision makers, so that monitoring the status of CPGs is of great importance to maintain in force the recommendations issued by the guides. A study by Shekelle et al.21 showed that most CPGs remain valid for a period of 3.6 years.
Regular monitoring of existing CPGs, and defining the maximum time to ensure their dissemination, is one way to ensure that CPG recommendations are used by professionals and that they are current. However, evidence regarding the best way to monitor and update CPGs is limited, and many CPG development groups have no formal update procedure.22-24 The updating of these guidelines is, therefore, a process that can be costly and time-consuming, similar to the development of a new CPG.24
CPGs must be updated
Assessing the need to update a CPG is essential to ensure the effectiveness of its recommendations. An outdated guide can lead to malpractice by failing to include new available information (Annex 1).
The questions to be asked regarding the need to update are:
The answer to these questions must start with the analysis of the CPG recommendations to be updated, its relevance, and its adaptation to new studies reviewed; i.e. one must assess to what extent the new results and the context (scientific, technological, sociological, cultural, and organizational) differ from the original CPG.
Types of CPG updates
The types of CPG updates include the following: full update, partial update, update without modification, or removal of the CPG (Table II).25
Table II Types of CPG update.Determining factors | |||
Type of update | Factors to be considered | Actions | |
Complete update | Most of the sections or chapters of the CPG need updating The majority of the recommendations have lost validity Areas to be included have been identified |
The scope and objectives of the CPG must be reviewed with the developer group | |
Partial update | Only some of the recommendations need updating Areas to be included have been identified |
Assess the objective and scope of the inclusion of a new recommendation with the developer group | |
Special update | A small number of recommendations may need updating in light of new evidence The special update can be a point that supports the identification of errors in a guide after its publication |
There are no changes in the scope and objective of the CPG Information to stakeholders |
|
Update without modifications | New information has not been identified There is no information from clinical practice To indicate the need to change recommendations |
The CPG does not require changes The guide is reviewed three years after publication to determine its timeliness |
|
Transfer to a static list | The recommendations will probably not change in the near future | There is no plan to upgrade They can be reviewed if new evidence emerges |
|
Evaluating its retirement | The CPG recommendations are no longer applicable It has been replaced by another more recent CPG on a topic The emergence of new preventive measures or treatment makes the CPG irrelevant |
Check the value of retirement with the group | |
Source: NICE, Process and methods guides.The Guidelines Manual, 2012 |
Literature search to develop and update the CPG
For the integration of a CPG, it is vital to carry out an information search protocol that ideally should be done by a librarian with experience in the clinical area or health sciences, in order to comprehensively and systematically obtain the most available documents containing the best available clinical evidence.
In the initial part of the search protocol it is necessary to search for and define what the MeSH descriptors will be or, where appropriate, the free vocabulary terms to be used in the search strategies, always aiming to get the largest number of results in a timely and precise way to cover the content to be treated in the guide.
The search process should be carried out in the information sources to which one has access (which must also have scientific recognition), such as databases, meta search engines or specialized websites (PubMed, Embase, NGC, NICE, SIGN, for example).
The aim of the guide is to present information with the best available clinical evidence. In the search protocol development, CPG first will be looked for that are published on the subject in question, by scientific and academic institutions with recognition so that, once evaluated, they can be adopted or adapted to the national context.
If sufficient guidance on the subject of the CPG to be developed is not found, or it does not have the methodological or content rigor needed to be adopted or adapted to the reality of Mexico, it will be necessary to find other types of documents with the highest level of evidence possible.
The search protocol must be reproducible and validatable. This is so that, once it is finished, documents that support the CPG development have been selected and retrieved. This protocol will be sent to a librarian with experience in the clinical area or health sciences, who, in turn, will reproduce it and validate that the search process is relevant to the aims and objectives of the guide.
It is absolutely necessary to identify all published systematic reviews on the topic of interest. Systematic reviews allow one to assess the degree of relevance of the recommendations contained in the selected guidelines, and incorporate recent and relevant evidence to the adaptation process (if this is not included in the selected guides).
The search for systematic reviews should be conducted in the databases Medline, Lilacs, Tripdatabase, Cochrane Library, and CRD (Centre for Reviews and Dissemination). A specific search strategy must be developed for each of the databases, according to their characteristics and descriptors.
Another complementary resource that can be also considered in the search is the Health Technology Assessment (Evaluación de Tecnologías Sanitarias) database, which can be consulted free of charge at the following link: http://www.crd.york.ac.uk/crdweb/
One of the critical resources for required consultation in the identification of systematic reviews is the Cochrane Library.
In summary, the main purpose of the search is to obtain information that is
Once one starts developing the search protocol, one must know:
Using descriptors and the basic terms of the title, and a summary of the main systematic reviews and large trials should be enough to build new search strategies. This should be run from the full year which ended the original search forward and should be repeated when the update is almost complete to check relevant studies have been published. This is not recommended when new questions or new technologies arise requiring renewal. Search strategies, when appropriate, should be made with a more comprehensive approach (Algorithm 2).
Algorithm 2 Search strategies for scientific literature to evaluate the need to update CPGs and the literature identification phrase
Evidence classification systems and recommendation strength
The concept of evidence-based medicine (EBM) was developed by a group of internists and clinical epidemiologists, led by Guyatt, from the School of Medicine at McMaster University in Canada. In Sackett’s words, "EMB is the conscious, explicit, and judicious use of the best available clinical evidence to make decisions about the care of individual patients".27
In essence, EBM aims to have the best scientific information available: the evidence to apply to clinical practice.
The stage of evidence presentation is the organization of available information as related to qualitative characteristics, design, and type of results from the available studies. The classification of evidence lets one make recommendations on the inclusion or exclusion of an intervention within the CPG.
There are different ways of grading evidence based on the scientific rigor of the study design; scales can be constructed for the hierarchical classification of evidence based on which recommendations can be established on the adoption of a specific medical procedure or health intervention.
Although there are different gradation scales for the quality of scientific evidence, they are all very similar to each other; some are presented in (Tables III, IV, V, VI).
Table III The modified scale of Shekelleet al. | |
Classifies evidence in levels (categories) and indicates the origin of the recommendations issued by degree of force. To establish the category of evidence it uses Roman numerals from I to IV and the letters a and b (lowercase).On the strength of recommendation it uses uppercase letters from A to D. |
|
Category of evidence | Strength of recommendation |
Ia Evidence for meta-analysis of randomized controlled trials. | A directly based on category I evidence |
Ib. Evidence from at least one randomized controlled trial | |
IIa. Evidence from at least one controlled study without randomization | B. directly based on category II evidence or extrapolated recommendations from category I evidence |
II b.Evidence from at least one other type of quasi-experimental study | |
III. Evidence from a non-experimental descriptive study, such as comparative studies, correlation studies, and case-control studies | C. directly based on category III evidence or extrapolated recommendations from categories I or II evidence |
IV. Evidence from expert committee reports or opinions or clinical experience of respected authorities, or both | D. directly based on category IV evidence or recommendations extrapolated from category II or III evidence |
Modified: Shekelle P, Wolf S, Eccles M, Grimshaw J. Clinical guidelines.Developing guidelines.BMJ 1999; 3:18:593-59 |
Table IV Scottish Intercollegiate Guidelines Network (SIGN) | |
Levels of scientific evidence | |
1++ | High-quality meta analyses, high-quality systematic reviews of clinical trials with very little risk of bias. |
1+ | Well-conducted meta-analyses, systematic review of clinical trials or well-conducted clinical trials with low risk of bias. |
1- | Meta-analyses, systematic reviews of clinical trials or clinical trials with high risk of bias. |
2++ | High-quality systematic reviews of cohort or case and control studies; cohort or case and control studies with very low risk of bias and high probability of establishing a causal relationship. |
2+ | Well-conducted cohort or case and control studies with low risk of bias and moderate probability of establishing a causal relationship. |
2- | Cohort or case and control studies with high risk of bias and significant risk that the relationship is not causal. |
3 | Non-analytical studies, such as case reports and case series. |
4 | Expert opinion. |
Grades of recommendations | |
A | At least one meta-analysis, systematic review or clinical trial classified as 1++ and directly applicable to the target population of the guideline, or a volume of scientific evidence comprising studies classified as 1+ and which are highly consistent with each other. |
B | A body of scientific evidence comprising studies classified as 2++, directly applicable to the target population of the guideline and highly consistent with each other, or scientific evidence extrapolated from studies classified as 1++ or 1+. |
C | A body of scientific evidence comprising studies classified as 2+, directly applicable to the target population of the guideline and highly consistent with each other, or scientific evidence extrapolated from studies classified as 2++. |
D | Level 3 or 4 scientific evidence, or scientific evidence extrapolated from studies classified as 2+. |
? | Advice of developer group |
Point of good practice |
Table V The National Health and Medical Research Council’s (NHMRC) | Designations of ‘levels of evidence’ according to type of research question | |||
Level | Intervention | Diagnosis | Prognosis and diagnosis | Etiology and risk factors |
I | A systematic review of level II studies | A systematic review of level II studies | A systematic review of level II studies | A systematic review of level II studies |
II | A randomized controlled trial | A study of test accuracy with: an independent, blinded comparison with a valid reference standard, among consecutive persons with a defined clinical presentation | A prospective cohort study | A randomized controlled trial |
III-1 | A pseudo-randomized controlled trial(i.e. alternate allocation or some other method) | A study of test accuracy with: an independent, blinded comparison with a valid reference standard, among non-consecutive persons with a defined clinical presentation | All or none | A pseudo-randomized controlled trial (i.e. alternate allocation or some other method) |
III-2 | A comparative study with concurrent controls:
|
A comparison with reference standard that does not meet the criteria required for Level II and III-1 evidence | Analysis of prognostic factors amongst persons in a single arm of a randomized controlled trial | A comparative study with concurrent controls:
|
III-3 | A comparative study without concurrent controls:
|
Diagnostic case-control study | A retrospective cohort study | A comparative study without concurrent controls:
|
IV | Case series with either post-test or pre-test/post-test outcomes | Study of diagnostic yield (no reference standard) | Case series, or cohort study of persons at different stagesof disease | Case series |
Modified from: The Clinical Epidemiology and Health Service Evaluation Unit, Melbourne Health in collaboration with the Delirium Clinical Guidelines Expert Working Group. Clinical Practice Guidelines for the Management of Delirium in Older People. October, 2006. Available at www.health.vic.gov.au/acute-agedcare |
Table VI Classification of level of evidence by GRADE system (Grading of Recommendations of Assessment Development and Evaluations), GRADE Working Group, 2006 | |
Level of evidence | Assessment of risk |
High | It is very unlikely that new studies will change the trust we have in the estimated result |
Moderate | It is likely that new studies will have an impact on the trust we have and may modify the result |
Low | It is very likely that new studies will have a major impact on the trust we have and may modify the result |
Very low | The result has not been demonstrated |
Ethics and conflict of interest statement
In CPG preparation it is very important to consider the ethical issues that accompany the disease and the corresponding diagnostic and therapeutic procedures. The observance of bioethical aspects improves health care services through a more humane medical practice, a positive attitude towards patients, less paternalism in the doctor-patient relationship, and higher quality in medical decisions. Based on the above, it is crucial to consider the four initial principles of bioethics in the construction of the CPG.
Considering the above principles, it is important for authors developing and validating a CPG to declare whether or not there is a conflict of interest because the CPG presents a summary of recommendations whose content can influence decision making by different health professionals who use them in their clinical practice. It is important that the end user of the guides know the relationship that individual developer authors may have with the pharmaceutical industry, ensuring independence and transparency in its creation or updating.
A conflict of interest occurs in circumstances where professional judgment on a primary interest (such as patient safety or the validity of research) may be influenced excessively by a secondary interest, be it a financial benefit, desire for professional advancement, recognition of personal achievement, or favors to friends, relatives, students, or colleagues.
Another way of understanding conflict of interest is when there are different types of interest: personal and non-personal. Personal interest involves any direct payment to a member of the group; and non-personal interest involves payment that benefits a department or organization where the member works, although they do not receive it personally.
The interests usually declared are financial, not because they are more harmful than others, but because they are measurable and can be evaluated objectively. The potential conflict of interest can exist regardless of whether or not the professional believes that such relations have influence on their scientific judgment. Relationships that can link a health professional with the pharmaceutical industry are classified into six types of financial interactions.
Being a shareholder or having financial interests in a pharmaceutical company.
The statement must be recorded and documented in a written form specially designed for this purpose. The form must be requisitioned by the declarant and submitted to the CPG coordinator. Ideally this process should be repeated at each meeting of the development group if there has been any development regarding the interests initially declared.
If a member of this group declared a potential conflict of interest in all (development of evidence and recommendations) or in a limited part of the guide (including articles that favor a drug), their participation in the development process should be assessed by the leader of the guide, along with the project coordinator, to determine whether the declared interests are such that the professional is discouraged from being part of the development group or just in some phases of the process.
CPGs are useful tools for standardizing decision-making processes and improving the quality of care.
In Mexico, there is a legal basis and clinical support to develop CPGs that help the decisions of healthcare professionals and their patients regarding the correct health care for specific clinical circumstances.
CPGs are aimed at professionals and patients with the aim of providing information for decision-making in health interventions. Their origins have foundations in EMB and their development is intended to reduce the variability of medical practice to ensure optimum quality and improve health care.
It is essential to have the tools that allow us access to the right information in terms of quantity, quality, and timeliness, to contribute to better decision making, since under the premise of equity in care, health care should not vary between medical and health institutions.
It is evident that the use of CPGs is currently an urgent need in medical intervention to synthesize the state of scientific knowledge and establish a balance between risks and benefits, and the ability to provide alternative treatments for each patient.
The design and development of CPGs helps define standards to improve medical care by incorporating current scientific knowledge. Selecting quality scientific knowledge requires that whoever develops the CPG have the necessary tools, the ability to critically read the literature, and also the capacity for synthesis and clear exposition, which facilitates the interpretation and implementation of the CPG in the local context.
The challenge in advancing CPGs is on the one hand updating it to incorporate evidence and recommendations based primarily on systematic reviews of the scientific literature. On the other hand, we must improve the process to generate the key recommendations that can be practical and feasible for the user, and serve as a starting point to generate research on the effectiveness and cost-effectiveness in the national context, as alternatives giving more validity and quality in the performance of medical practice.
CPGs are not tools that restrict freedom of health personnel in clinical practice, since they must provide recommendations flexible enough to adapt to the characteristics of a particular patient ("there are no sicknesses, only sick people").
Annex 1 Evaluation of the need to update the CPG
Annex 2 Resources and sources of information for the development and updating of clinical practice guidelines | |
Recommended resources | |
Compilers | Web address |
AHRQ National Guidelines Clearinghouse | www.guideline.gov |
NHS National Library of Guideline | www.library.nhs.uk/GuidelinesFinder |
Guía Salud | www.guíasalud.es |
Developer institutions | |
Scottish Intercollegiate Guideline Network | www.sign.ac.uk |
National Institute for Clinical Excellence | www.nice.org.uk |
Australian National Health and Medical Research Council | www.nhmrc.gov.au |
New Zealand Guidelines Group | www.nzgg.org.nz |
Meta search engines | |
TRIP database | www.tripdatabase.com |
Clinical Excellence | www.excelenciaclinica.net |
Other | |
MEDLINE via PubMed | www.ncbi.nim.gov/sites/entrez |
Web sites of scientific societies | |
SI Web of Science | http://isiknowledge.com |
Systematic reviews and health technology assessment reports | |
Databases | |
Centre for Reviews and Dissemination database | www.crd.york.ac.uk/crdweb |
Cochrane Database of Systematic Reviews | www.thecochranelibrary.org |
Cochrane Plus Library | www.bibliotecacochrane.net |
MEDLINE via PubMed | www.ncbi.nlm.nih.gov/sites/entrez |
Meta search engines | |
TRIP database | www.tripdatabase.com |
Clinical Excellence | www.excelenciaclinica.net |
Up to date | www.uptodate.com |
Dynamed | www.ebscohost.com/dynamed |
Original studies | |
Databases | |
ISI Web of Science | http://isiknowledge.com |
MEDLINE via PubMed (Clinical Queries) | www.ncbi.nlm.nih.gov/entrez/query/static/clinical.shtml |
Databases of ongoing studies | |
ClinicalTrials | http://ClinicalTrials.gov |
Current Controlled Trials | www.controlled-trials.com |
International Clinical Trials Registry Platform | www.who.int/ictrp |
Other (secondary journals and contacts with experts) | |
Electronic alerts (Evidence updates) | http://plus.macmaster.ca/EvidenceUpdates/ |
Conflict of interest statement: The authors have completed and submitted the form translated into Spanish for the declaration of potential conflicts of interest of the International Committee of Medical Journal Editors, and none were reported in relation to this article.