High modernism and expert knowledge

James Scott is one of the really exceptional social scientists of his generation.  His contributions to peasant studies have been transformative -- his ideas of the "moral economy of the peasant" and "weapons of the weak" are now part of the tool set that we all use in trying to make sense of agrarian societies (The Moral Economy of the Peasant: Rebellion and Subsistence in Southeast Asia, Weapons of the Weak: Everyday Forms of Peasant Resistance, Domination and the Arts of Resistance: Hidden Transcripts).  And his historical and ethnographic accounts of peasant life and struggle have given us a strong basis for understanding these movements that were so important during the anti-colonial struggles of the mid-twentieth century.  (I've treated several of these contributions in earlier posts here, here, here, and here.)

What is particularly striking about Scott's work is the range of his sociological imagination.  He is a genuinely creative thinker when it comes to making sense of some of some very complex human phenomena -- peasant mobilization, agricultural modernization, and large-scale efforts to transform the world.  Each of his books introduces something new (for example, his treatment of Gramsci and hegemony in Weapons of the Weak, or his use of "hidden transcripts" in Domination and the Arts of Resistance).  He is a master at coming up with a concept, theory, or metaphor that can help to explain complex forms of social behavior, from the points of view of the actors.  And he does a great job of overcoming the dichotomy between "material circumstances" and "culture"; the peasant communities and movements that he treats are both materially situated and culturally specific.

A more recent book that makes a number of important new contributions is Seeing Like a State: How Certain Schemes to Improve the Human Condition Have Failed (1998).  Here Scott shifts focus in two ways.  His analysis here differs from his earlier books in that it is both more macro -- he examines the ways that states think; and more micro -- he also examines the nature of individually situated expert local knowledge.  Both parts of the analysis are interesting and novel.

The book explores what Scott calls "high modernism" -- essentially, the effort to use science and theory to order and regularize the social world, and to use theories of the future to remake the present.  Scott defines high modernism in these terms:

It is best conceived as a strong, one might even say muscle-bound, version of the beliefs in scientific and technical progress that were associated with industrialization in Western Europe and in North America from roughly 1830 until World War I. At its core was a supreme self-confidence about continued linear progress, the development of scientific and technical knowledge, the expansion of production, the rational design of social order, the growing satisfaction of human needs, and, not least, an increasing control over nature. (89)

Initially he puts the point in terms of the modern state's agenda of "sedentarianization" -- reducing the mobility and anonymity of nomadic peoples and organizing them into "legible" formations.

The more I examined these efforts at sedentarization, the more I came to see them as a state's attempt to make a society legible, to arrange the population in ways that simplified the classic state functions of taxation, conscription, and prevention of rebellion. (2)

Much of early modern European statecraft seemed similarly devoted to rationalizing and standardizing what was a social hieroglyph into a legible and administratively more convenient format.  The social simplifications thus introduced not only permitted a more finely tuned system of taxation and conscription but also greatly enhanced state capacity. (Introduction)

The core thesis of the book is the damage that states have done when they have attempted to implement antecedent theories of social change:

I believe that many of the most tragic episodes of state development in the late nineteenth and twentieth centuries originate in a particularly pernicious combination of three elements.  The first is the aspiration to the administrative ordering of nature and society, an aspiration that we have already seen at work in scientific forestry, but one raised to a far more comprehensive and ambitious level....  The second element is the unrestrained use of the power of the modern state as an instrument for achieving these designs.  The third element is a weakened or prostrate civil society that lacks the capacity to resist these plans. (88-89)

High modernism was evident in agriculture; but it was also visible in urban planning.

Le Corbusier had no patience for the physical environment that centuries of urban living had created. He heaped scorn on the tangle, darkness, and disorder, the crowded and pestilential conditions, of Paris and other European cities at the turn of the century ... He was visually offended by disarray and confusion. (106)

The French-inspired urban design of colonial-era Saigon is pictured above.

Scott's view is that the central development disasters of the twentieth century derived from this toxic combination of epistemic arrogance and authoritarian power, including especially an excessive confidence in the ability of principles of "scientific management" to order and organize human activity.  He provides case studies of the creation of Brasilia as a completely planned city; Soviet collectivization of agriculture in 1929-30; villagization in Tanzania; and the effort to regularize and systematize modern agriculture (266).  And we could add China's Great Leap Forward famine to the list.  In each case, the high-modernist ideology led to a catastrophic failure of social development.

In sum, the legibility of a society provides the capacity for largescale social engineering, high-modernist ideology provides the desire, the authoritarian state provides the determination to act on that desire, and an incapacitated civil society provides the leveled social terrain on which to build. (5)

A constant contrast in the book is between the objectifying knowledge of modernist science -- social and natural -- and the particular knowledge systems of practitioners and locals about the nature of their local environment -- what he calls "metis".  "Throughout this book I make the case for the indispensable role of practical knowledge, informal processes, and improvisation in the face of unpredictability" (6).  A particularly clear instance of these two perspectives comes in through Scott's discussion of scientific forestry and the local knowledge of forest ecology possessed by villagers.  Beekeeping, traditional farming, and the cultivation of the mango tree (333) are other good examples.  Two forests are pictured below; the first is an old-growth forest, and the second is the result of scientific forestry. And Scott documents the ecological destruction that resulted when these principles of scientific forestry were exported from Germany to Southeast Asia.

Scott's perspective here is not anti-scientific or anti-modern.  Instead, it is fundamentally anti-authoritarian: the high-modernist impulse coupled with the power of the modern state has led to massive human disasters.  And confidence in comprehensive, abstract theories -- whether of forests, bees, or cities -- has been an important element of these destructive endeavors.  So the conclusion is a moderate one: pay attention to local knowledge, be suspicious of totalizing experiments in transforming society or nature, and trust the people who are affected by policies to contribute to their design.

Scott's arguments in Seeing Like a State provide some resonance with two other insightful writers discussed in earlier postings: Michael Polanyi (on the importance of tacit knowledge) and Karl Popper (on the hazards associated with comprehensive social engineering).

(Scott's most recent book is The Art of Not Being Governed: An Anarchist History of Upland Southeast Asia.  Here is a very interesting working paper by Grant Evans reviewing Scott's contributions; From moral economy to remembered village: The sociology of James C. Scott (Working paper / Centre of Southeast Asian Studies, Monash University).)

High modernism and expert knowledge

James Scott is one of the really exceptional social scientists of his generation.  His contributions to peasant studies have been transformative -- his ideas of the "moral economy of the peasant" and "weapons of the weak" are now part of the tool set that we all use in trying to make sense of agrarian societies (The Moral Economy of the Peasant: Rebellion and Subsistence in Southeast Asia, Weapons of the Weak: Everyday Forms of Peasant Resistance, Domination and the Arts of Resistance: Hidden Transcripts).  And his historical and ethnographic accounts of peasant life and struggle have given us a strong basis for understanding these movements that were so important during the anti-colonial struggles of the mid-twentieth century.  (I've treated several of these contributions in earlier posts here, here, here, and here.)

What is particularly striking about Scott's work is the range of his sociological imagination.  He is a genuinely creative thinker when it comes to making sense of some of some very complex human phenomena -- peasant mobilization, agricultural modernization, and large-scale efforts to transform the world.  Each of his books introduces something new (for example, his treatment of Gramsci and hegemony in Weapons of the Weak, or his use of "hidden transcripts" in Domination and the Arts of Resistance).  He is a master at coming up with a concept, theory, or metaphor that can help to explain complex forms of social behavior, from the points of view of the actors.  And he does a great job of overcoming the dichotomy between "material circumstances" and "culture"; the peasant communities and movements that he treats are both materially situated and culturally specific.

A more recent book that makes a number of important new contributions is Seeing Like a State: How Certain Schemes to Improve the Human Condition Have Failed (1998).  Here Scott shifts focus in two ways.  His analysis here differs from his earlier books in that it is both more macro -- he examines the ways that states think; and more micro -- he also examines the nature of individually situated expert local knowledge.  Both parts of the analysis are interesting and novel.

The book explores what Scott calls "high modernism" -- essentially, the effort to use science and theory to order and regularize the social world, and to use theories of the future to remake the present.  Scott defines high modernism in these terms:

It is best conceived as a strong, one might even say muscle-bound, version of the beliefs in scientific and technical progress that were associated with industrialization in Western Europe and in North America from roughly 1830 until World War I. At its core was a supreme self-confidence about continued linear progress, the development of scientific and technical knowledge, the expansion of production, the rational design of social order, the growing satisfaction of human needs, and, not least, an increasing control over nature. (89)

Initially he puts the point in terms of the modern state's agenda of "sedentarianization" -- reducing the mobility and anonymity of nomadic peoples and organizing them into "legible" formations.

The more I examined these efforts at sedentarization, the more I came to see them as a state's attempt to make a society legible, to arrange the population in ways that simplified the classic state functions of taxation, conscription, and prevention of rebellion. (2)

Much of early modern European statecraft seemed similarly devoted to rationalizing and standardizing what was a social hieroglyph into a legible and administratively more convenient format.  The social simplifications thus introduced not only permitted a more finely tuned system of taxation and conscription but also greatly enhanced state capacity. (Introduction)

The core thesis of the book is the damage that states have done when they have attempted to implement antecedent theories of social change:

I believe that many of the most tragic episodes of state development in the late nineteenth and twentieth centuries originate in a particularly pernicious combination of three elements.  The first is the aspiration to the administrative ordering of nature and society, an aspiration that we have already seen at work in scientific forestry, but one raised to a far more comprehensive and ambitious level....  The second element is the unrestrained use of the power of the modern state as an instrument for achieving these designs.  The third element is a weakened or prostrate civil society that lacks the capacity to resist these plans. (88-89)

High modernism was evident in agriculture; but it was also visible in urban planning.

Le Corbusier had no patience for the physical environment that centuries of urban living had created. He heaped scorn on the tangle, darkness, and disorder, the crowded and pestilential conditions, of Paris and other European cities at the turn of the century ... He was visually offended by disarray and confusion. (106)

The French-inspired urban design of colonial-era Saigon is pictured above.

Scott's view is that the central development disasters of the twentieth century derived from this toxic combination of epistemic arrogance and authoritarian power, including especially an excessive confidence in the ability of principles of "scientific management" to order and organize human activity.  He provides case studies of the creation of Brasilia as a completely planned city; Soviet collectivization of agriculture in 1929-30; villagization in Tanzania; and the effort to regularize and systematize modern agriculture (266).  And we could add China's Great Leap Forward famine to the list.  In each case, the high-modernist ideology led to a catastrophic failure of social development.

In sum, the legibility of a society provides the capacity for largescale social engineering, high-modernist ideology provides the desire, the authoritarian state provides the determination to act on that desire, and an incapacitated civil society provides the leveled social terrain on which to build. (5)

A constant contrast in the book is between the objectifying knowledge of modernist science -- social and natural -- and the particular knowledge systems of practitioners and locals about the nature of their local environment -- what he calls "metis".  "Throughout this book I make the case for the indispensable role of practical knowledge, informal processes, and improvisation in the face of unpredictability" (6).  A particularly clear instance of these two perspectives comes in through Scott's discussion of scientific forestry and the local knowledge of forest ecology possessed by villagers.  Beekeeping, traditional farming, and the cultivation of the mango tree (333) are other good examples.  Two forests are pictured below; the first is an old-growth forest, and the second is the result of scientific forestry. And Scott documents the ecological destruction that resulted when these principles of scientific forestry were exported from Germany to Southeast Asia.

Scott's perspective here is not anti-scientific or anti-modern.  Instead, it is fundamentally anti-authoritarian: the high-modernist impulse coupled with the power of the modern state has led to massive human disasters.  And confidence in comprehensive, abstract theories -- whether of forests, bees, or cities -- has been an important element of these destructive endeavors.  So the conclusion is a moderate one: pay attention to local knowledge, be suspicious of totalizing experiments in transforming society or nature, and trust the people who are affected by policies to contribute to their design.

Scott's arguments in Seeing Like a State provide some resonance with two other insightful writers discussed in earlier postings: Michael Polanyi (on the importance of tacit knowledge) and Karl Popper (on the hazards associated with comprehensive social engineering).

(Scott's most recent book is The Art of Not Being Governed: An Anarchist History of Upland Southeast Asia.  Here is a very interesting working paper by Grant Evans reviewing Scott's contributions; From moral economy to remembered village: The sociology of James C. Scott (Working paper / Centre of Southeast Asian Studies, Monash University).)

High modernism and expert knowledge

James Scott is one of the really exceptional social scientists of his generation.  His contributions to peasant studies have been transformative -- his ideas of the "moral economy of the peasant" and "weapons of the weak" are now part of the tool set that we all use in trying to make sense of agrarian societies (The Moral Economy of the Peasant: Rebellion and Subsistence in Southeast Asia, Weapons of the Weak: Everyday Forms of Peasant Resistance, Domination and the Arts of Resistance: Hidden Transcripts).  And his historical and ethnographic accounts of peasant life and struggle have given us a strong basis for understanding these movements that were so important during the anti-colonial struggles of the mid-twentieth century.  (I've treated several of these contributions in earlier posts here, here, here, and here.)

What is particularly striking about Scott's work is the range of his sociological imagination.  He is a genuinely creative thinker when it comes to making sense of some of some very complex human phenomena -- peasant mobilization, agricultural modernization, and large-scale efforts to transform the world.  Each of his books introduces something new (for example, his treatment of Gramsci and hegemony in Weapons of the Weak, or his use of "hidden transcripts" in Domination and the Arts of Resistance).  He is a master at coming up with a concept, theory, or metaphor that can help to explain complex forms of social behavior, from the points of view of the actors.  And he does a great job of overcoming the dichotomy between "material circumstances" and "culture"; the peasant communities and movements that he treats are both materially situated and culturally specific.

A more recent book that makes a number of important new contributions is Seeing Like a State: How Certain Schemes to Improve the Human Condition Have Failed (1998).  Here Scott shifts focus in two ways.  His analysis here differs from his earlier books in that it is both more macro -- he examines the ways that states think; and more micro -- he also examines the nature of individually situated expert local knowledge.  Both parts of the analysis are interesting and novel.

The book explores what Scott calls "high modernism" -- essentially, the effort to use science and theory to order and regularize the social world, and to use theories of the future to remake the present.  Scott defines high modernism in these terms:

It is best conceived as a strong, one might even say muscle-bound, version of the beliefs in scientific and technical progress that were associated with industrialization in Western Europe and in North America from roughly 1830 until World War I. At its core was a supreme self-confidence about continued linear progress, the development of scientific and technical knowledge, the expansion of production, the rational design of social order, the growing satisfaction of human needs, and, not least, an increasing control over nature. (89)

Initially he puts the point in terms of the modern state's agenda of "sedentarianization" -- reducing the mobility and anonymity of nomadic peoples and organizing them into "legible" formations.

The more I examined these efforts at sedentarization, the more I came to see them as a state's attempt to make a society legible, to arrange the population in ways that simplified the classic state functions of taxation, conscription, and prevention of rebellion. (2)

Much of early modern European statecraft seemed similarly devoted to rationalizing and standardizing what was a social hieroglyph into a legible and administratively more convenient format.  The social simplifications thus introduced not only permitted a more finely tuned system of taxation and conscription but also greatly enhanced state capacity. (Introduction)

The core thesis of the book is the damage that states have done when they have attempted to implement antecedent theories of social change:

I believe that many of the most tragic episodes of state development in the late nineteenth and twentieth centuries originate in a particularly pernicious combination of three elements.  The first is the aspiration to the administrative ordering of nature and society, an aspiration that we have already seen at work in scientific forestry, but one raised to a far more comprehensive and ambitious level....  The second element is the unrestrained use of the power of the modern state as an instrument for achieving these designs.  The third element is a weakened or prostrate civil society that lacks the capacity to resist these plans. (88-89)

High modernism was evident in agriculture; but it was also visible in urban planning.

Le Corbusier had no patience for the physical environment that centuries of urban living had created. He heaped scorn on the tangle, darkness, and disorder, the crowded and pestilential conditions, of Paris and other European cities at the turn of the century ... He was visually offended by disarray and confusion. (106)

The French-inspired urban design of colonial-era Saigon is pictured above.

Scott's view is that the central development disasters of the twentieth century derived from this toxic combination of epistemic arrogance and authoritarian power, including especially an excessive confidence in the ability of principles of "scientific management" to order and organize human activity.  He provides case studies of the creation of Brasilia as a completely planned city; Soviet collectivization of agriculture in 1929-30; villagization in Tanzania; and the effort to regularize and systematize modern agriculture (266).  And we could add China's Great Leap Forward famine to the list.  In each case, the high-modernist ideology led to a catastrophic failure of social development.

In sum, the legibility of a society provides the capacity for largescale social engineering, high-modernist ideology provides the desire, the authoritarian state provides the determination to act on that desire, and an incapacitated civil society provides the leveled social terrain on which to build. (5)

A constant contrast in the book is between the objectifying knowledge of modernist science -- social and natural -- and the particular knowledge systems of practitioners and locals about the nature of their local environment -- what he calls "metis".  "Throughout this book I make the case for the indispensable role of practical knowledge, informal processes, and improvisation in the face of unpredictability" (6).  A particularly clear instance of these two perspectives comes in through Scott's discussion of scientific forestry and the local knowledge of forest ecology possessed by villagers.  Beekeeping, traditional farming, and the cultivation of the mango tree (333) are other good examples.  Two forests are pictured below; the first is an old-growth forest, and the second is the result of scientific forestry. And Scott documents the ecological destruction that resulted when these principles of scientific forestry were exported from Germany to Southeast Asia.

Scott's perspective here is not anti-scientific or anti-modern.  Instead, it is fundamentally anti-authoritarian: the high-modernist impulse coupled with the power of the modern state has led to massive human disasters.  And confidence in comprehensive, abstract theories -- whether of forests, bees, or cities -- has been an important element of these destructive endeavors.  So the conclusion is a moderate one: pay attention to local knowledge, be suspicious of totalizing experiments in transforming society or nature, and trust the people who are affected by policies to contribute to their design.

Scott's arguments in Seeing Like a State provide some resonance with two other insightful writers discussed in earlier postings: Michael Polanyi (on the importance of tacit knowledge) and Karl Popper (on the hazards associated with comprehensive social engineering).

(Scott's most recent book is The Art of Not Being Governed: An Anarchist History of Upland Southeast Asia.  Here is a very interesting working paper by Grant Evans reviewing Scott's contributions; From moral economy to remembered village: The sociology of James C. Scott (Working paper / Centre of Southeast Asian Studies, Monash University).)

Who invented the totalitarian state?

 
The world has known ruthless, violent, and murderous rulers for centuries.  Queen Elizabeth ran a secret service that ruthlessly pursued her enemies in the Catholic underground.  Isabella and Ferdinand persecuted and expelled the Jews of Spain.  And the French government was perfectly ready to use deadly force against workers and rebels in Paris in 1848 and 1871.  But the totalitarian state was a creation of the twentieth century.  The fascist states of Italy, Spain, and Germany as well as the Soviet state seem to have been qualitatively different from even the most repressive of their nineteenth century predecessors. By comparison, Bismarck's Prussia, Napoleon III's France, Czar Alexander's Russia, and Victor Emmanuel's Italy were quaint amateur affairs when it came to organized coercion and mass politics.

The differences are striking -- the apparatus of political prisons, the extensive secret police networks, the purposive use of violent organizations, the ideologies of national and ethnic purity.  Most fundamental, though, is the degree and depth of bureaucratic control that the modern totalitarian state achieved.  This is what made the modern fascist or soviet state "total" -- an ability to monitor and intimidate civil society down to the street level.

The distinction between the realm of the state and the realm of civil society has been fundamental to political theory.  Civil society encompasses the private activities of individuals and their associations, and the realm of the state involves the political apparatus of law, enforcement, and coercion.  We can roughly estimate the degree to which the apparatus of the state is able to penetrate down into civil society.  And European states prior to the twentieth century were objectively limited in their capacity to rule civil society.  This is true for the imperial Chinese state in the nineteenth century as well; it was commonly said that the power of the Emperor ended at the yamen wall (or at the county level).  As Mark Allee puts it in Law and Local Society in Late Imperial China: Northern Taiwan in the Nineteenth Century,

The limited effectiveness of yamen runners as police prompted local administrators in Danshui and Xinzhu to search for ways to augment and supplement their runner cadre. In so doing, sub-prefecture and county heads aimed to create more intimate linkages to the people in their jurisdiction and to extend the reach of local government beyond the yamen wall into the countryside. (197)

Weak states have only a limited ability to enforce their will against the mass populations of city and countryside; mechanisms such as tax farming and collective tax liability are therefore called upon in order to secure the resources needed by the central authorities.  And the scope of law and the effective enforcement of laws and decrees is limited as well in a weak state.  European polities of the nineteenth century were generally weak states; Britain, France, Germany, and Italy had central governments with only limited administrative capacity and limited ability to impose their authority at the local level.  But there was a dramatic increase in the beginning of the twentieth century in the administrative capacity of the state and its ability to govern local society.  The scope of the political grew much broader, and the domain of civil society -- the relatively safe and insulated zone of individual activity and choice -- grew more limited.  The creation of the totalitarian state depended on this radical increase in state power and state coercive capacity.

A striking feature of the totalitarian states of the twentieth century is their aggressiveness and brutality towards all opposition.  These fascist states were ruthless and effective in their ability to attack and dismantle oppositional groups -- including communists, labor unions, radical peasants, rent resistance organizations, liberals, and anarchists.  Chuck Tilly's discussion of "trust networks" is relevant here; the balance of power between the trust networks of civil society and the central power of the state apparatus shifted profoundly with the advent of the modern dictatorship; Trust and Rule.

One index of the administrative and coercive capacity of the state is the degree to which it is successful in exacting a greater percentage of the national wealth in taxes.  Weak states are relatively inefficient at collecting taxes.  So careful historical study of systems of taxation is an important contribution to the topic of the power of the state.  Isaac Martin, Ajay Mehrotra, and Monica Prasad's The New Fiscal Sociology: Taxation in Comparative and Historical Perspective provides a good exposure to the field of comparative fiscal sociology. With a foreword and article by Charles Tilly, it examines the ways in which states since the early modern period have intensified their ability to collect tax revenues.

One piece of this new capacity was organizational.  Fascist states in the 1930s created bureaucracies of surveillance, enforcement, punishment, and killing that went vastly beyond the capacity of nineteenth century state organizations.  The organizations of police and army in Italy, Spain, and Germany took major steps forward in size and complexity in the twentieth century.  The personnel of the forces of coercion -- police and other armed state forces such as militias -- were few in the early nineteenth century; but by the middle of the twentieth century these numbers had grown exponentially.

Improved communication and transportation were also key to the possibility of the totalitarian state.  The telephone and the railroad allowed fascist states to collect information quickly and to move their forces around the cities and countryside efficiently; functionally, this meant that rural groups and ordinary people were no longer buffered from the state by poor roads and rudimentary communication.

Another technological advance that was crucial for the totalitarian state was a substantial improvement in the technology of record keeping and retrieval.  James Scott argues that the modern state's imperative to regiment and record its population is fundamental to its capacity to collect taxes and conscript soldiers  -- and therefore fundamental to the nature of modern political power (Seeing Like a State: How Certain Schemes to Improve the Human Condition Have Failed).  The technology of organized record keeping improved dramatically in the first several decades of the twentieth century -- thus making the state's goal of closely monitoring its subjects more attainable.  (Edwin Black describes the use of IBM punch card systems to manage National Socialist records of Jews and other enemies in IBM and the Holocaust.)  So communication, transportation, and record-keeping were crucial to the creation of the totalitarian state.

Of course greater state capacity is not synonymous with totalitarianism.  Liberal democratic states too increased their capacity to impose their will at the local level.  What distinguished totalitarian regimes was the set of ideological and political goals that fascist states sought to accomplish on the basis of their greater repressive capacity and the cult of violence that each embodied.  Other states took some of these sorts of steps forward in the twentieth century; the "reach of the state" increased dramatically in the United States, France, and Britain as well.  The administrative functions of the state and the ability to extract revenues through taxation increased exponentially.  It would be interesting to compare the total tax percentages in 1860 and 1930 for the United States and France; surely the increase is dramatic.  And likewise, the personnel of these states increased dramatically during the same time period as a percentage of population.  But this broad increase in state capacity did not lead to repression and dictatorship in these countries.

This topic is historically interesting; much turns on how we explain the power and human tragedies associated with Franco's Spain or Mussolini's Italy.  But it is also interesting today when we consider the undisguised efforts of the Iranian state, and its Republican Guard military organization, to dominate the whole of Iranian civil society.  Here too we see the use of surveillance, intimidation, mass arrests, forced confessions, and political murder as tactics in the effort to control civil society.

(There is quite a bit of scope for new comparative historical research on this topic.  Chuck Tilly has always emphasized these issues in his analysis of the development of the modern state.  Michael Mann's findings in The Sources of Social Power, Vol. 2: The Rise of Classes and Nation States, 1760-1914 are certainly relevant as well to this line of thought.  But there isn't much empirical detail available at present.  Simply attempting to measure the dimensions highlighted here for a number of countries -- scale of tax collections, size of state apparatus, size and complexity of police organizations, and overall state capacity to regulate local society -- requires research that doesn't appear to exist at present. )

Who invented the totalitarian state?

 
The world has known ruthless, violent, and murderous rulers for centuries.  Queen Elizabeth ran a secret service that ruthlessly pursued her enemies in the Catholic underground.  Isabella and Ferdinand persecuted and expelled the Jews of Spain.  And the French government was perfectly ready to use deadly force against workers and rebels in Paris in 1848 and 1871.  But the totalitarian state was a creation of the twentieth century.  The fascist states of Italy, Spain, and Germany as well as the Soviet state seem to have been qualitatively different from even the most repressive of their nineteenth century predecessors. By comparison, Bismarck's Prussia, Napoleon III's France, Czar Alexander's Russia, and Victor Emmanuel's Italy were quaint amateur affairs when it came to organized coercion and mass politics.

The differences are striking -- the apparatus of political prisons, the extensive secret police networks, the purposive use of violent organizations, the ideologies of national and ethnic purity.  Most fundamental, though, is the degree and depth of bureaucratic control that the modern totalitarian state achieved.  This is what made the modern fascist or soviet state "total" -- an ability to monitor and intimidate civil society down to the street level.

The distinction between the realm of the state and the realm of civil society has been fundamental to political theory.  Civil society encompasses the private activities of individuals and their associations, and the realm of the state involves the political apparatus of law, enforcement, and coercion.  We can roughly estimate the degree to which the apparatus of the state is able to penetrate down into civil society.  And European states prior to the twentieth century were objectively limited in their capacity to rule civil society.  This is true for the imperial Chinese state in the nineteenth century as well; it was commonly said that the power of the Emperor ended at the yamen wall (or at the county level).  As Mark Allee puts it in Law and Local Society in Late Imperial China: Northern Taiwan in the Nineteenth Century,

The limited effectiveness of yamen runners as police prompted local administrators in Danshui and Xinzhu to search for ways to augment and supplement their runner cadre. In so doing, sub-prefecture and county heads aimed to create more intimate linkages to the people in their jurisdiction and to extend the reach of local government beyond the yamen wall into the countryside. (197)

Weak states have only a limited ability to enforce their will against the mass populations of city and countryside; mechanisms such as tax farming and collective tax liability are therefore called upon in order to secure the resources needed by the central authorities.  And the scope of law and the effective enforcement of laws and decrees is limited as well in a weak state.  European polities of the nineteenth century were generally weak states; Britain, France, Germany, and Italy had central governments with only limited administrative capacity and limited ability to impose their authority at the local level.  But there was a dramatic increase in the beginning of the twentieth century in the administrative capacity of the state and its ability to govern local society.  The scope of the political grew much broader, and the domain of civil society -- the relatively safe and insulated zone of individual activity and choice -- grew more limited.  The creation of the totalitarian state depended on this radical increase in state power and state coercive capacity.

A striking feature of the totalitarian states of the twentieth century is their aggressiveness and brutality towards all opposition.  These fascist states were ruthless and effective in their ability to attack and dismantle oppositional groups -- including communists, labor unions, radical peasants, rent resistance organizations, liberals, and anarchists.  Chuck Tilly's discussion of "trust networks" is relevant here; the balance of power between the trust networks of civil society and the central power of the state apparatus shifted profoundly with the advent of the modern dictatorship; Trust and Rule.

One index of the administrative and coercive capacity of the state is the degree to which it is successful in exacting a greater percentage of the national wealth in taxes.  Weak states are relatively inefficient at collecting taxes.  So careful historical study of systems of taxation is an important contribution to the topic of the power of the state.  Isaac Martin, Ajay Mehrotra, and Monica Prasad's The New Fiscal Sociology: Taxation in Comparative and Historical Perspective provides a good exposure to the field of comparative fiscal sociology. With a foreword and article by Charles Tilly, it examines the ways in which states since the early modern period have intensified their ability to collect tax revenues.

One piece of this new capacity was organizational.  Fascist states in the 1930s created bureaucracies of surveillance, enforcement, punishment, and killing that went vastly beyond the capacity of nineteenth century state organizations.  The organizations of police and army in Italy, Spain, and Germany took major steps forward in size and complexity in the twentieth century.  The personnel of the forces of coercion -- police and other armed state forces such as militias -- were few in the early nineteenth century; but by the middle of the twentieth century these numbers had grown exponentially.

Improved communication and transportation were also key to the possibility of the totalitarian state.  The telephone and the railroad allowed fascist states to collect information quickly and to move their forces around the cities and countryside efficiently; functionally, this meant that rural groups and ordinary people were no longer buffered from the state by poor roads and rudimentary communication.

Another technological advance that was crucial for the totalitarian state was a substantial improvement in the technology of record keeping and retrieval.  James Scott argues that the modern state's imperative to regiment and record its population is fundamental to its capacity to collect taxes and conscript soldiers  -- and therefore fundamental to the nature of modern political power (Seeing Like a State: How Certain Schemes to Improve the Human Condition Have Failed).  The technology of organized record keeping improved dramatically in the first several decades of the twentieth century -- thus making the state's goal of closely monitoring its subjects more attainable.  (Edwin Black describes the use of IBM punch card systems to manage National Socialist records of Jews and other enemies in IBM and the Holocaust.)  So communication, transportation, and record-keeping were crucial to the creation of the totalitarian state.

Of course greater state capacity is not synonymous with totalitarianism.  Liberal democratic states too increased their capacity to impose their will at the local level.  What distinguished totalitarian regimes was the set of ideological and political goals that fascist states sought to accomplish on the basis of their greater repressive capacity and the cult of violence that each embodied.  Other states took some of these sorts of steps forward in the twentieth century; the "reach of the state" increased dramatically in the United States, France, and Britain as well.  The administrative functions of the state and the ability to extract revenues through taxation increased exponentially.  It would be interesting to compare the total tax percentages in 1860 and 1930 for the United States and France; surely the increase is dramatic.  And likewise, the personnel of these states increased dramatically during the same time period as a percentage of population.  But this broad increase in state capacity did not lead to repression and dictatorship in these countries.

This topic is historically interesting; much turns on how we explain the power and human tragedies associated with Franco's Spain or Mussolini's Italy.  But it is also interesting today when we consider the undisguised efforts of the Iranian state, and its Republican Guard military organization, to dominate the whole of Iranian civil society.  Here too we see the use of surveillance, intimidation, mass arrests, forced confessions, and political murder as tactics in the effort to control civil society.

(There is quite a bit of scope for new comparative historical research on this topic.  Chuck Tilly has always emphasized these issues in his analysis of the development of the modern state.  Michael Mann's findings in The Sources of Social Power, Vol. 2: The Rise of Classes and Nation States, 1760-1914 are certainly relevant as well to this line of thought.  But there isn't much empirical detail available at present.  Simply attempting to measure the dimensions highlighted here for a number of countries -- scale of tax collections, size of state apparatus, size and complexity of police organizations, and overall state capacity to regulate local society -- requires research that doesn't appear to exist at present. )

Who invented the totalitarian state?

 
The world has known ruthless, violent, and murderous rulers for centuries.  Queen Elizabeth ran a secret service that ruthlessly pursued her enemies in the Catholic underground.  Isabella and Ferdinand persecuted and expelled the Jews of Spain.  And the French government was perfectly ready to use deadly force against workers and rebels in Paris in 1848 and 1871.  But the totalitarian state was a creation of the twentieth century.  The fascist states of Italy, Spain, and Germany as well as the Soviet state seem to have been qualitatively different from even the most repressive of their nineteenth century predecessors. By comparison, Bismarck's Prussia, Napoleon III's France, Czar Alexander's Russia, and Victor Emmanuel's Italy were quaint amateur affairs when it came to organized coercion and mass politics.

The differences are striking -- the apparatus of political prisons, the extensive secret police networks, the purposive use of violent organizations, the ideologies of national and ethnic purity.  Most fundamental, though, is the degree and depth of bureaucratic control that the modern totalitarian state achieved.  This is what made the modern fascist or soviet state "total" -- an ability to monitor and intimidate civil society down to the street level.

The distinction between the realm of the state and the realm of civil society has been fundamental to political theory.  Civil society encompasses the private activities of individuals and their associations, and the realm of the state involves the political apparatus of law, enforcement, and coercion.  We can roughly estimate the degree to which the apparatus of the state is able to penetrate down into civil society.  And European states prior to the twentieth century were objectively limited in their capacity to rule civil society.  This is true for the imperial Chinese state in the nineteenth century as well; it was commonly said that the power of the Emperor ended at the yamen wall (or at the county level).  As Mark Allee puts it in Law and Local Society in Late Imperial China: Northern Taiwan in the Nineteenth Century,

The limited effectiveness of yamen runners as police prompted local administrators in Danshui and Xinzhu to search for ways to augment and supplement their runner cadre. In so doing, sub-prefecture and county heads aimed to create more intimate linkages to the people in their jurisdiction and to extend the reach of local government beyond the yamen wall into the countryside. (197)

Weak states have only a limited ability to enforce their will against the mass populations of city and countryside; mechanisms such as tax farming and collective tax liability are therefore called upon in order to secure the resources needed by the central authorities.  And the scope of law and the effective enforcement of laws and decrees is limited as well in a weak state.  European polities of the nineteenth century were generally weak states; Britain, France, Germany, and Italy had central governments with only limited administrative capacity and limited ability to impose their authority at the local level.  But there was a dramatic increase in the beginning of the twentieth century in the administrative capacity of the state and its ability to govern local society.  The scope of the political grew much broader, and the domain of civil society -- the relatively safe and insulated zone of individual activity and choice -- grew more limited.  The creation of the totalitarian state depended on this radical increase in state power and state coercive capacity.

A striking feature of the totalitarian states of the twentieth century is their aggressiveness and brutality towards all opposition.  These fascist states were ruthless and effective in their ability to attack and dismantle oppositional groups -- including communists, labor unions, radical peasants, rent resistance organizations, liberals, and anarchists.  Chuck Tilly's discussion of "trust networks" is relevant here; the balance of power between the trust networks of civil society and the central power of the state apparatus shifted profoundly with the advent of the modern dictatorship; Trust and Rule.

One index of the administrative and coercive capacity of the state is the degree to which it is successful in exacting a greater percentage of the national wealth in taxes.  Weak states are relatively inefficient at collecting taxes.  So careful historical study of systems of taxation is an important contribution to the topic of the power of the state.  Isaac Martin, Ajay Mehrotra, and Monica Prasad's The New Fiscal Sociology: Taxation in Comparative and Historical Perspective provides a good exposure to the field of comparative fiscal sociology. With a foreword and article by Charles Tilly, it examines the ways in which states since the early modern period have intensified their ability to collect tax revenues.

One piece of this new capacity was organizational.  Fascist states in the 1930s created bureaucracies of surveillance, enforcement, punishment, and killing that went vastly beyond the capacity of nineteenth century state organizations.  The organizations of police and army in Italy, Spain, and Germany took major steps forward in size and complexity in the twentieth century.  The personnel of the forces of coercion -- police and other armed state forces such as militias -- were few in the early nineteenth century; but by the middle of the twentieth century these numbers had grown exponentially.

Improved communication and transportation were also key to the possibility of the totalitarian state.  The telephone and the railroad allowed fascist states to collect information quickly and to move their forces around the cities and countryside efficiently; functionally, this meant that rural groups and ordinary people were no longer buffered from the state by poor roads and rudimentary communication.

Another technological advance that was crucial for the totalitarian state was a substantial improvement in the technology of record keeping and retrieval.  James Scott argues that the modern state's imperative to regiment and record its population is fundamental to its capacity to collect taxes and conscript soldiers  -- and therefore fundamental to the nature of modern political power (Seeing Like a State: How Certain Schemes to Improve the Human Condition Have Failed).  The technology of organized record keeping improved dramatically in the first several decades of the twentieth century -- thus making the state's goal of closely monitoring its subjects more attainable.  (Edwin Black describes the use of IBM punch card systems to manage National Socialist records of Jews and other enemies in IBM and the Holocaust.)  So communication, transportation, and record-keeping were crucial to the creation of the totalitarian state.

Of course greater state capacity is not synonymous with totalitarianism.  Liberal democratic states too increased their capacity to impose their will at the local level.  What distinguished totalitarian regimes was the set of ideological and political goals that fascist states sought to accomplish on the basis of their greater repressive capacity and the cult of violence that each embodied.  Other states took some of these sorts of steps forward in the twentieth century; the "reach of the state" increased dramatically in the United States, France, and Britain as well.  The administrative functions of the state and the ability to extract revenues through taxation increased exponentially.  It would be interesting to compare the total tax percentages in 1860 and 1930 for the United States and France; surely the increase is dramatic.  And likewise, the personnel of these states increased dramatically during the same time period as a percentage of population.  But this broad increase in state capacity did not lead to repression and dictatorship in these countries.

This topic is historically interesting; much turns on how we explain the power and human tragedies associated with Franco's Spain or Mussolini's Italy.  But it is also interesting today when we consider the undisguised efforts of the Iranian state, and its Republican Guard military organization, to dominate the whole of Iranian civil society.  Here too we see the use of surveillance, intimidation, mass arrests, forced confessions, and political murder as tactics in the effort to control civil society.

(There is quite a bit of scope for new comparative historical research on this topic.  Chuck Tilly has always emphasized these issues in his analysis of the development of the modern state.  Michael Mann's findings in The Sources of Social Power, Vol. 2: The Rise of Classes and Nation States, 1760-1914 are certainly relevant as well to this line of thought.  But there isn't much empirical detail available at present.  Simply attempting to measure the dimensions highlighted here for a number of countries -- scale of tax collections, size of state apparatus, size and complexity of police organizations, and overall state capacity to regulate local society -- requires research that doesn't appear to exist at present. )

Koestler's nightmares

Image: book burning by National Socialist paramilitaries, 1933

Image: Ukraine peasants fleeing famine

Image: street battle, Spanish Civil War

Arthur Koestler was an articulate witness of the atrocities of the twentieth century; and much of what he witnessed was terrible.  Reading his books gives one an intense and personal vision of fascism, dictatorship, mass murder, starvation, and cruelty on a monstrous scale.  As George Orwell wrote of Koestler's books in 1944, "The subject-matter of all of them is similar, and none of them ever escapes for more than a few pages from the atmosphere of nightmare" (link).  Koestler worked as a Communist journalist in Berlin in the early 1930s during the rise of the brown shirts; he was the first European journalist to travel through the Ukraine to witness the results of famine in Stalin's war against the Kulaks (Lynne Viola, The War Against the Peasantry, 1927-1930: The Tragedy of the Soviet Countryside); and he observed the Spanish Civil War, where he was arrested after the fall of Malaga, imprisoned, and sentenced to death as a Red.  (Here is an earlier post on Koestler.)

These experiences are described in his autobiography, The Invisible Writing, and the narrative of his experiences in Spain is presented in Dialogue With Death.  But Koestler's best known book is a novel, Darkness at Noon, which is the story of the final weeks of life of the fictional Soviet revolutionary Rubashov in Stalin's purges of the 1930s and the Moscow show trials.  After a life as leader, theorist, and agent in service of the Soviet Union and the Communist Party, Rubashov is arrested for fictitious crimes of conspiracy and betrayal against the State.  He is arrested before dawn; it takes him quite a while to find his pince-nez.  He is thrown into a Soviet political prison -- it is reminiscent to him of the fascist prisons in which he had suffered beatings and torture years earlier.  He is brought to confess to these crimes and others under interrogation by his former comrade-in-arms, Ivanov, and the new Soviet thug, Gletkin.  Ivanov is psychologically manipulative; Gletkin is brutal; but both strive to break Rubashov and compel his confession.  They are successful; Rubashov confesses to betraying the Revolution; and like Bukharin, he is convicted and summarily shot in the back of the neck.  Along the way there is quite a bit of debate about history, the individual, the Party, and the Future of Humanity.  The key question of the novel is the puzzle: why did Rubashov confess rather than following the secret advice of the prison barber -- "die in silence!"?

Koestler himself was a committed Communist agent in Berlin in the 1930s; so his descriptions of Rubashov's activities in eastern Europe have the ring of truth -- including Rubashov's betrayals of Richard and Little Loewy in the name of socialism.  The novel recreates the Moscow show trials of 1937 with uncanny insight.  Rubashov is loosely based on Nikolai Bukharin, one of the intellectual and political leaders of the Russian Revolution.  Koestler's novel was written only two years after the trial and execution of these leaders of the Russian Revolution at the hands of Stalin's functionaries.  Here is what he says about the central character:

The characters in this book are fictitious.  The historical circumstances which determined their actions are real.  The life of the man N. S. Rubashov is a synthesis of the lives of a number of men who were victims of the so-called Moscow Trials.  Several of them were personally known to the author.  This book is dedicated to their memory.  Paris, October, 1938-April, 1940

But here is what I find fascinating.  Koestler's fictional recreation of the arrest and trial of the top Party officials, in the person of Rubashov, and the background assumptions and rationalizations assumed by the prosecutors and interrogators, is remarkably close to the historical reality.  Here is Koestler's description of his own arrest and arrival in a Spanish fascist prison in Malaga:

It is a unique sound.  A cell door has no handle, either outside or inside; it cannot be shut except by being slammed to.  It is made of massive steel and concrete, about four inches thick, and every time it falls to there is a resounding crash just as though a shot has been fired.  But this report dies away without an echo.  Prison sounds are echo-less and bleak.

When the door has been slammed behind him for the first time, the prisoner stands in the middle of the cell and looks round. I fancy that everyone must behave in more or less the same way.

First of all he gives a fleeting look round the walls and takes a mental inventory of all the objects in what is now to be his domain:

• the iron bedstead,
• the wash-basin,
• the W.C.,
• the barred window.

His next action is invariably to try to pull himself up by the iron bars of the window and look out.  He fails, and his suit is covered with white from the plaster on the wall against which he has pressed himself. (Dialogue with Death, 59)

And now turn to Rubashov's first few minutes in Stalin's jail cell:

Rubashov walked up and down in the cell, from the door to the window and back, between bunk, wash-basin and bucket, six and a half steps there, six and a half steps back.  At the door he turned to the right, at the window to the left.  It was an old prison habit; if one did not change the direction of the turn one rapidly became dizzy. ....  Rubashov stood hesitantly in the middle of the cell, then put his pince-nez on again and propped himself at the window. (Darkness at Noon, 14, 18)

Much of the drama of Darkness at Noon is the series of interrogations Rubashov undergoes, and the mental transformation that they bring about in this courageous man to bring him to confess to the most farfetched and unbelievable crimes.  The transcripts of Bukharin's prosecution exist; Robert Tucker and Stephen Cohen's THE GREAT PURGE TRIAL provides extensive transcripts of the interrogation of Bukharin and other show trial victims.  It is striking to compare the interrogation of Bukharin with the interrogation of Rubashov.  Consider this bit of interrogation of Rubashov, beginning with the voice of prosecutor Ivanov:

"To return to more tangible things: you mean, therefore, that 'we' -- namely, Party and State -- no longer represent the interests of the Revolution, of the masses or, if you like, the progress of humanity."

"This time you have grasped it," said Rubashov smiling.  Ivanov did not answer his smile.
"When did you develop this opinion?"

"Fairly gradually: during the last few years," said Rubashov.

"Can't you tell me more exactly? One year? Two? Three years?"

"That's a stupid question," said Rubashov. "At what age did you become adult? At seventeen? At eighteen and a half? At nineteen?"

"It's you who are pretending to be stupid," said Ivanov.  "Each step in one's spiritual development is the result of definite experiences.  If you really want to know: I became a man at seventeen, when I was sent into exile for the first time." (69)

And now a similar moment in the actual transcripts of the interrogation of Bukharin.

Vyshinsky: Allow me to begin the interrogation of the accused Bukharin. Formulate briefly what exactly it is you plead guilty to.

Bukharin: Firstly, to belonging to the counter-revolutionary "Bloc of Rights and Trotskyites."

Vyshinsky: Since what year?

 Bukharin: Roughly since 1928. I plead guilty to being one of the outstanding leaders of this "Bloc of Rights and Trotskyites." Consequently I plead guilty to what directly follows from this, the sum total of crimes committed by this counter-revolutionary organization, irrespective of whether or not I knew of, whether or not I took a direct part, in any particular act.  Because I am responsible as one of the leaders and not as a cog in this counter-revolutionary organization.

Vyshinsky: What aims were pursued by this counter-revolutionary organization?
Bukharin: This counter-revolutionary organization, to formulate it briefly ...

Vyshinsky: Yes, briefly for the present.

Bukharin: The principal aim it pursued, although, so to speak, it did not fully realize it, and did not dot all the "i's" -- was essentially the aim of restoring capitalist relations in the U.S.S.R. (Tucker, 328)

And now, back to Darkness at Noon and Rubashov; the porter's daughter reads aloud the newspaper account of the last minutes of Rubashov's testimony:

"Asked whether he pleaded guilty, the accused Rubashov answered 'Yes' in a clear voice.  To a further question of the Public Prosecutor as to whether the accused had acted as an agent of the counter-revolution, he again answered 'Yes' in a lower voice ...."

Here seems to be Koestler's own explanation of the puzzle of the confessions:

Some were silenced by physical fear, like Hare-lip; some hoped to save their heads; others at least to save their wives or sons from the clutches of the Gletkins.  The best of them kept silent in order to do a last service to the Party, by letting themselves be sacrificed as scapegoats -- and, besides, even the best had each an Arlova on his conscience.  They were too deeply entangled in their own past, caught in the web they had spun themselves, according to the laws of their own twisted ethics and twisted logic; they were all guilty, although not of those deeds of which they accused themselves.  There was no way back for them.  Their exit from the stage happened strictly according to the rules of their strange game.  The public expected no swan-songs of them.  They had to act according to the text-book, and their part was the howling of wolves in the night.... (DN, 105)

Fiction and reality are deeply intertwined here.  I don't believe that Koestler had access to transcripts of the show trials at the time he wrote Darkness at Noon in 1940, though he had read accounts of the trials.  So the convergence of the fictional Rubashov and the historical Bukharin is remarkable.  And the transformation of Koestler's own experiences -- in Communist activism and in fascist prison under sentence of death -- into the fiction of Rubashov is very striking.

The state prosecutor who conducted the show trial of Bukharin was Andrei Vyshinsky.  Following his success in the show trials, Vyshinsky became a prominent diplomat under Stalin.  And after World War II he served as permanent representative to the United Nations during the period that the Universal Declaration on Human Rights was drafted and adopted.  He led the Soviet Bloc nations in abstention from the vote adopting the Universal Declaration on Human Rights.  Here is a fragment of the outrageous speech he gave on this occasion:

Human rights could not be conceived outside the State; the very concept of right and law was connected with that of the State. (The Universal Declaration of Human Rights: Origins, Drafting, and Intent, 21-22)

I am drawn to Koestler's writings -- both his fiction and his autobiographical writings --  in part because he provides such a powerful example of an engaged mind attempting to make sense of the history around him. Much of his work is a first-person effort to "understand society" -- to make sense of the social forces and individual behavior that the twentieth century presented.  George Orwell is another of my favorites in this aspect of literature, including especially Homage to Catalonia and A Collection of Essays; so it is very interesting to me that Orwell wrote the short essay about Koestler mentioned above.  It is also interesting that they were both published in England by Victor Gollancz, along with E. P. Thompson.

(Louis Menand has an interesting profile of Koestler in the New Yorker this month.)