Modelling and analysis of the dynamics of adaptive temporal–causal network models for evolving social interactions

Background Network-Oriented Modelling based on adaptive temporal–causal networks provides a unified approach to model and analyse dynamics and adaptivity of various processes, including mental and social interaction processes. Methods Adaptive temporal–causal network models are based on causal relations by which the states in the network change over time, and these causal relations are adaptive in the sense that they themselves also change over time. Results It is discussed how modelling and analysis of the dynamics of the behaviour of these adaptive network models can be performed. The approach is illustrated for adaptive network models describing social interaction. Conclusions In particular, the homophily principle and the ‘more becomes more’ principles for social interactions are addressed. It is shown how the chosen Network-Oriented Modelling method provides a basis to model and analyse these social phenomena.

model by checking them for the values observed in simulation experiments. If one of these properties is not fulfilled (and the mathematical analysis was done in a correct manner), then there will be some error in the implementation of the model. In this paper, methods to analyse such properties of temporal-causal network models will be described. They will be illustrated for two types for dynamic connection weights in adaptive temporal-causal network models modelling evolving social interaction: one based on the homophily principle ("Modelling evolving social interactions by adaptive networks based on the homophily principle" section), and one based on the more becomes more principle ("Modelling evolving social interactions by adaptive networks based on the 'more becomes more' principle" section). A preliminary, shorter presentation of part of the work described here can be found in [17].
• combination function c Y (..) For each state Y (a reference to) a combination function c Y (..) is chosen to aggregate the causal impacts of other states on state Y. This can be a standard function from a library (e.g. a scaled sum function) or an own-defined function. • speed factor η Y For each state Y, a speed factor η Y is used to represent how fast a state is changing upon causal impact, usually in the [0, 1] interval.
In the first place, a conceptual representation of a temporal-causal network model involves representing in a declarative manner states and connections between them. The connections represent (causal) impacts of states on each other, as assumed to hold for the application domain addressed. Each state X is assumed to have an (activation) level that varies over time, indicated in the numerical representation by a real number X(t). In reality, not all causal relations are equally strong, so some notion of strength of a connection from a state X to a state Y is used: a connection weight ω X,Y . Combination functions can have different forms. The applicability of a specific combination rule may depend much on the type of application addressed, and even on the type of states within an application. Therefore, for the Network-Oriented Modelling approach based on temporal-causal networks a number of standard combination functions are available as options and a number of relevant properties of such combination functions have been identified; e.g. see [10], Table 10, or [1], Chapter 2, Table 2. 10. Some of these standard combination functions are scaled sum, product, complementary product, max, min, and simple and advanced logistic sum functions (for some of these examples of combination functions the numerical representations are discussed in "From a conceptual representation to a numerical representation" section). These options cover elements from different existing approaches, varying from approaches considered for reasoning with uncertainty, probability, possibility or vagueness, to approaches based on neural networks; e.g. [18][19][20][21][22][23][24][25][26]. In addition, there is still the option to specify any other (non-standard) combination function.

Conceptual representations for an adaptive network
The above three concepts (connection weight, combination function, speed factor) can be considered as parameters representing characteristics in a network model. In a nonadaptive network model, these parameters are fixed over time. But to model processes by adaptive networks, not only the state levels, but also these parameters can change over time. For example, the connection weights can change over time to model evolving connections in network models. For modelling processes as adaptive networks, some of the parameters (such as connection weights) are handled in a similar manner as states. For example, see Fig. 1, where the states affect the connection between them, as happens, for example, in adaptive social networks based on the homophily principle (see "Modelling evolving social interactions by adaptive networks based on the homophily principle" section).
This can be represented differently by considering the connection weight ω X,Y as a state X,Y that changes over time, represented by an extra node in the network. As a first step, this node for the state X,Y representing ω X,Y is added and connected; see Fig. 2 for a conceptual representation. In the new situation depicted in Fig. 2, the weight ω X,Y is represented by a state X,Y with activation values � X,Y (t) the same as the connection weight values ω X,Y (t) in the old situation for each t: � X,Y (t) = ω X,Y (t). This state X,Y is affected by both X and Y, so connections from these states to X,Y are incorporated. Moreover, a connection from X,Y to Y is used to represent the effect of the connection strength on Y, and a connection from X,Y to itself for persistence. The weights of all these connections are assumed 1; see Fig. 2. As a next step, it is explored what combination functions are needed for X,Y and Y in this new situation depicted in Fig. 2.
First, a combination function c X,Y (..) for the state X,Y has to be assumed, to aggregate the impacts of X and Y, and X,Y on X,Y . This will depend on the adaptation principle that is chosen. Next, the new combination function for Y has to be determined. Below the corresponding combination functions will be discussed in more numerical detail.

From a conceptual representation to a numerical representation
Based on a conceptual representation of a temporal-causal network model, in order to obtain a numerical representation of the network model the following concepts can be defined: • The impact of state X on state Y at time t impact X,Y (t) The impact of state X on state Y at time t is defined by Here X(t) is the activation level of state X at t. Note that also a connection from a state Y to itself is allowed. The weight ω Y ,Y of such a connection can, for example, be used to model persistence of state Y. • The aggregated impact on state Y at time t aggimpact Y (t) When more than one causal relation affects a given state Y, these causal effects have to be combined. To this end, some way to aggregate multiple causal impacts on a state is used; this is done using a combination function c Y (..) that uses the impacts impact X i ,Y (t) from states X 1 , …, X k on Y as input and provides one aggregated impact value out of them: • Moreover, not every state has the same extent of flexibility in responding to impact; some states respond fast, and other states may be more rigid and may respond more slowly. Therefore, a speed factor η Y of a state Y is used for timing of effectuation of causal impacts, as shown in the following difference and differential equations: Given the above concepts, a conceptual representation of a temporal-causal network model can be transformed in a systematic and automated manner into a numerical representation of the model, thus obtaining the following difference and differential equation for each state Y, expressed using the basic elements ω X,Y , c Y (. . .), and η Y of a conceptual representation of the model: The numerical representations of some example combination functions are as follows:.

Numerical representation of a scaled sum combination function
In some cases, it is useful to apply a scaling factor to the sum combination function by dividing it by some scaling factor : In cases where this combination function is used for a state Y with X 1 , . . . , X k connected to Y, then this function works as follows on the X i :

Numerical representation of a simple logistic sum combination function
The logistic sum combination function has two closely related variants, the simple variant and the more advanced variant (see below). In these functions, τ is a threshold parameter and σ a steepness parameter. The simple logistic function is defined as: .
To indicate the dependence of σ and τ , sometimes these are used as subscripts: In cases where this combination function is used for a state Y with X 1 , . . . , X k connected to Y, then this function works as follows on the X i :

Numerical representation of an advanced logistic sum combination function
In the simple logistic variant, it holds slogistic(0, . . . , 0) = 1/(1 + e σ τ ), and this is nonzero, which is undesirable property as it creates in an unintended manner activation out of no activation. This issue is compensated for in the advanced variant. The advanced logistic sum combination function is defined as To indicate the dependence of σ and τ , sometimes these are used as subscripts: For an overview of a number of standard combination functions, see Table 1.

Numerical representations for an adaptive network
In the simple example depicted in Fig. 1, Y has another impact from Z, besides the impact from X. Then in the new situation depicted in Fig. 2, there are not just two but three states with impact on Y, namely X, Z and X,Y . This requires a new combination function c * Y (V 1 , V 2 , W ) for Y with three arguments, which is applied to the impacts X(t), ω Z,X Z(t) and � X,Y (t) on Y, obtaining aggregated impact c * Y (X(t), ω Z,X Z(t), � X,Y (t)). This aggregated impact is equal to c Y (ω X,Y (t)X(t), ω Z,Y Z(t)) in the previous model representation depicted in Fig. 1. Therefore, For example, if in the situation of Fig. 1 which is a combination of a product and a sum function. More in general, suppose in total there are k states X i with impact on Y, according to combination function c Y (V 1 , . . . , V k ). If all these connections are adaptive, then the new combination function becomes

Modelling evolving social interactions by adaptive networks based on the homophily principle
Next an adaptive temporal-causal network model is discussed to model evolving social interactions based on the homophily principle. According to this principle, also indicated as 'birds of a feather flock together' , connections are strengthened if the connected states are similar. For example, when two persons both like the same type of music, movies, drinks, and parties, they may strengthen their connection. For the current model, the dynamic connection weights ω X A ,X B from state X A of person A to state X B of person B are assumed to change over time based on the principle that the closer the activation levels of the states of the interacting persons, the stronger the mutual connections between the persons will become, and the higher the difference between the activation levels, the weaker they will become. For a conceptual representation, see Fig. 3. As discussed in "Network-Oriented Modelling by temporal-causal networks" section, ω X A ,X B can be represented by state X A ,X B and the weights of the connections involving X A ,X B are assumed 1: the weights of the connections from X A and X B to X A ,X B , and from X A ,X B to X B and to itself. Based on this according to the temporal-causal network approach, the homophily principle may be formalised using the following general format and a combination function c A,B (V 1 , V 2 , W ) that still has to be determined: Examples of such combination functions can be obtained when a threshold value τ � X A ,X B is assumed such that the connection weight X A ,X B becomes stronger when |X A (t) − X B (t)| < τ � X A ,X B (levels of X A and X B close to each other) and weaker when |X A (t) − X B (t)| > τ � X A ,X B (levels of X A and X B not so close to each other). The following is an example which is linear in X A (t) and X B (t): The factor β can be made dependent on , with α an amplification parameter. This makes the combination function

Table 1 Overview of a number of standard combination functions
where V 1 , V 2 refer to X A , X B and W to X A ,X B . Thus, we obtain the following: The combination function for X B can be found in the same way as in the "Network-Oriented Modelling by temporal-causal networks" section for Y.
In Figs. 4 and 5, as an illustration, an example simulation for this homophily model is shown, based on a (fully connected) example network of 10 states X 1 to X 10 , with the initial values of the connection weights shown in Table 2. For the contagion between states, a dynamic scaled sum function has been used in which, at each point in time, the scaling factor is equal to the sum of the connection weights involved. The homophily threshold τ was set at 0.025, and the amplification factor α at 20. Speed factors for states were 0.5 and for connections 0.3.
All connection weights approximate either 0 or 1, as can be seen for a few examples (of the 90 connections) in Fig. 5. In Fig. 4, it is shown that clustering emerges, in this case in 3 clusters that in the end each are fully connected by connection weights 1, and the connection weights between states from different clusters have become practically 0. That such patterns always occur will be analysed further in the "Mathematical analysis for the homophily principle" section.

Modelling evolving social interactions by adaptive networks based on the 'more becomes more' principle
Another type of model for a dynamic connection from a person B to A takes into account to which extent other persons C connect to person A. The idea behind this is that somebody who is very popular seems worth connecting to. Sometimes this is called the 'more becomes more' principle, and in a wider context it relates to what sometimes is called 'the rich get richer' (Simon [27]), 'cumulative advantage' (Price [28]), 'the Matthew effect' (Merton [29]) or 'preferential attachment' (Barbasi [30]). For example, if B is followed by Graphical conceptual representation of an adaptive temporal-causal network model for the homophily principle many others C on Twitter, then B seems to be interesting to follow for A as well. As the connections of others to B may change over time, this will imply that A also will have a dynamic connection to B, and in turn this connection will affect the connection of others to B over time as well. This can be modelled taking into account the weights ω C i ,B for i = 1,…, k of all connections from others C i to B as shown in Fig. 6 in conceptual representation and in numerical representation as follows: Here c A,B (…) is a combination function for the values ω C 1 ,B , . . . , ω C k ,B ; for example, a logistic sum function or a scaled sum function with scale factor the number k of other persons connected to B. Note that the latter combination function only takes into account the average strengths of the connections, not the total number of them.
Note that a network modelling the initiation of connections is not automatically a network indicating social contagion; this will depend on the application considered. For example, a network modelling a connection from A to B when A is following B on Twitter will not play a role in social contagion from A to B. For social contagion, the opposite network plays a role where a connection from A to B occurs when A is followed by B, which is not initiated by A but by B: on Twitter and most other social media you cannot  Fig. 6 Conceptual representation of an adaptive temporal-causal network model for the 'more becomes more' principle appoint your own followers. As another example, when A often contacts B for advice, and this advice is often taken over by A, then the initiation connection is from A to B but the contagion connection is from B to A. In other cases, it may be different. For example, if A wants to announce an event or new product, he or she can choose an occasion where many others will see the message; for example, posting it on a suitable forum; in such a case both the initiation and the social contagion are directed from A to the others.

Mathematical analysis of temporal-causal network models
In this section, we discuss how some types of dynamic properties of adaptive temporalcausal network models can be analysed mathematically, in particular, stationary points and monotonicity. These are basic concepts that also can be found in [1], chapter 12 or [31] . A stationary point of a state occurs at some point in time if for this time point no change occurs: the graph is horizontal at that point. Stationary points are usually maxima or minima (peaks or dips) but sometimes also other stationary points may occur. An equilibrium occurs when for all states no change occurs. From the difference or differential equations describing the dynamics for a model, it can be analysed when stationary points or equilibria occur. Moreover, it can be found when a certain state is increasing or decreasing, when a state is not in a stationary point or equilibrium. First a definition for these notions.

Definition (stationary point, increase, decrease, and equilibrium)
The model is in equilibrium at t if every state Y of the model has a stationary point at t. This equilibrium is attracting when for any state Y, all values of Y in some neighbourhood of the equilibrium value increase when the value is below the equilibrium value and decrease when the value is above the equilibrium value.
A question that can be addressed is whether observations based on one or more simulation experiments are in agreement with a mathematical analysis. If it is found out that the observations are in agreement with the mathematical analysis, then this provides some extent of corroboration that the implemented model is correct. If they turn out not to be in agreement with the mathematical analysis, then this indicates that probably there is something wrong, and further inspection and correction has to be initiated. Considering the differential equation for a temporal-causal network model, more specific criteria can be found: where X 1 ,…, X k are the states with connections to Y. For example, it can be concluded that In this manner, the following criteria can be found:

Criteria for increase, decrease, stationary point and equilibrium
Let Y be a state and X 1 , . . . , X k the states connected toward Y. Then, the following hold: Note that these criteria can immediately be found from a conceptual representation of a temporal-causal network model, as long as the referred combination function is known. Using the above criteria, no further numerical representation is needed of the difference or differential equations, for example. From these criteria, more insight can be obtained about the behaviour of the network model, in particular which stationary points are possible for a state in the model, and which equilibria are possible for the whole model. Sometimes, the stationary point equation can be rewritten into an equation of the form Y(t) = .. such that Y(t) does not occur on the right-hand side. In the "Mathematical analysis for the homophily principle" and "Mathematical analysis for the 'more becomes more' principle" sections, examples of this are shown.
The criteria can also be used to verify (the implementation of ) the model based on inspection of stationary points or equilibria, in two different manners A and B. Note that in a given simulation the stationary points that are identified are usually approximately stationary; how closely they are approximated depends on different aspects, for example, on the step size, or on how long the simulation is done.

A. Verification by checking stationary points through substitution of the values from a simulation in the criterion
1. Generate a simulation. 2. Consider any state Y with a stationary point at any time point t and states X 1 , …, X k affecting it. 3. Substitute the values Y (t) and X 1 (t), …, X k (t) in the criterion c Y (ω X 1 ,Y X 1 (t), . . . , ω X k ,Y X k (t)) = Y (t). 4. If the equation holds (for example, with an accuracy <0.05), then this test succeeds, otherwise it fails 5. If this test fails, then it has to be explored were the error can be found Note that this method A. works without having to solve the equations, only substitution takes place; therefore it works for any choice of combination function. Moreover, note that the method also works when the values of the states fluctuate, for example according to a recurring pattern (a limit cycle). In such cases for each state, there are maxima (peaks) and minima (dips), which also are stationary points to which the method can be applied; here it is important to choose a small step size as each stationary point occurs at one time point only. There is still another method B. possible that can be applied sometimes; it is based on solving the equations for the stationary point values by symbolic rewriting. This can provide explicit expressions for stationary point values in for every state Y (i.e. a joint stationary state) terms of the parameters of the model. Such expressions can be used to predict equilibrium values for specific simulations, based on the choice of parameter values.

B. Verification by solving the equilibrium equations and comparing predicted equilibrium values to equilibrium values in a simulation
1. Consider the equilibrium equations for all states Y:

Leave the t out and denote the values as constants
An equilibrium is a solution X 1 , . . . , X k of the following set of n equilibrium equations in the n states X 1 , . . . , X n of the model: 3. Solve these equations mathematically in an explicit analytical form: for each state X i a mathematical formula X i = … in terms of the parameters of the model (connection weights and parameters in the combination function c X i (..), such as the steepness σ and threshold τ in a logistic sum combination function); more than one solution is possible. 4. Generate a simulation. 5. Identify equilibrium values in this simulation. 6. If for all states Y, the predicted value Y from a solution of the equilibrium equations equals the value for Y obtained from the simulation (for example, with an accuracy <0.05), then this test succeeds, otherwise it fails. 7. If this test fails, then it has to be explored where the error can be found.
For more details, see [1], chapter 12, or [31]. This method B. provides more, but a major drawback is that it cannot be applied in all situations; this depends on the chosen combination functions: e.g. for logistic functions, it does not work.

Mathematical analysis for the homophily principle
In the "Modelling evolving social interactions by adaptive networks based on the 'more becomes more' principle" section, it was shown how the homophily principle for evolving social interaction may be modelled using a combination function: In this section, we analyse which stationary points can occur for X A ,X B , according to the approach described in "Mathematical analysis of temporal-causal network models". For this case, the criterion from the "Mathematical analysis of temporal-causal network models" section for a stationary point is Clearly, for � X A ,X B (t) = 0 or � X A ,X B (t) = 1, one of the left-hand side factors in this condition is 0. In contrast, when 0 < � X A ,X B (t) < 1, the right-hand factor should equal 0: Therefore, in principle, there are three types of stationary points for � X A ,X B (t). Stationary points for � X A ,X B (t): Similarly, the following can be found. Increasing This shows that for cases that |X A (t) − X B (t) | < τ � X A ,X B the connection keeps on becoming stronger until � X A ,X B (t) approaches 1. Similarly for cases that |X A (t) − X B (t)| > τ � X A ,X B the connection keeps on becoming weaker until � X A ,X B (t) approaches 0. This implies that � X A ,X B (t) = 0 and � X A ,X B (t) = 1 can both become attracting, but under different circumstances concerning the values of X A (t) and X B (t) . In [1], chapter 11, section 11.7 for such an adaptive network model, an example simulation is shown where indeed the connection weights all converge to 0 or 1, and during this process clusters are formed of persons with equal levels of their state; see also [32].

Mathematical analysis for the 'more becomes more' principle
The criterion for stationary points applied to the adaptive network model for the 'more becomes more' principle is the following: where C 1 , . . . , C k , and A are the states connected to B. For a joint stationary point, this criterion applies to any state connected to B. Renaming A by C k+1 this can also be formulated by the following set of k + 1 equations for i = 1, . . . , k + 1: or written out: . . . c C k+1 ,B (ω C 1 ,B (t), . . . , ω Ck,B (t)) = ω C k+1 ,B (t) If for the combination function c C i ,B (..) the scaled sum function is chosen with scaling factor the number k, this provides the following set of k + 1 linear equations for a joint stationary state for the connections to B:

By multiplying both sides by k this provides
This set of equations can be solved easily. For each i, adding ω C i ,B (t) to both sides of the ith equation yields As all left-hand sides are equal now, it follows that the right-hand sides are equal as well, so for a joint stationary point for all i and j. Therefore in a joint stationary state for all connections ω C i ,B to B they have the same weight value.
By a slightly different argument a similar conclusion can be drawn when not a scaled sum combination function but a logistic combination function is chosen.
The aggregated impact on the connection weight ω C i ,B is given by .
with f(V ) a function defined by Here κ, μ, ν are positive constants: Using this function, for this case, the stationary point equations get the following uniform form: Therefore, the question becomes how many solutions the equation f(V ) = V has. Now e σ V is monotonically increasing in V, and therefore 1/(1 + κe σ V )) and also f(V ) are monotonically decreasing: This implies that the equation f(V ) = V has at most one solution. From this, it follows that also for the alogistic function as combination function in a joint stationary point all ω C i ,B values will be equal.
There is also an abstract general argument possible for a whole class of combination functions, namely, the combination functions that are (1) symmetric in their arguments and that are (2) monotonic: If in a fully connected network a combination function c(..) is used that is symmetric and monotonic and all connection weights between different states are the same (for example, assume all of them 1), and no connections occur from states to themselves, then the argument is as follows. Suppose all states have the same combination function and joint stationary points are given, so that for all i and j (assume i < j): then by symmetry Now suppose X i ≤ X j then by monotonicity X i = c(X 1 , . . . , X i−1 , X i+1 , . . . . . . , X k ) X j = c(X 1 , . . . . . . , X j−1 , X j+1 , . . . , X k ) X i = c(X 1 , . . . , X i−1 , X i+1 , . . . , X j−1 , X j+1 , . . . , X k , X j ) X j = c(X 1 , . . . , X i−1 , X i+1 , . . . , X j−1 , X j+1 , . . . , X k , X i ) From the above, it follows that X i = X j . The same argument applies when it is assumed X i ≥ X j . Therefore in this case, in a joint stationary point all state values are equal, which was also found above by more specific methods for the special cases of a scaled sum and an advanced logistic sum combination function, which indeed both are symmetric and monotonic combination functions. Thus, we obtain the following theorem: Theorem When in a fully connected network with equal connection weights a combination function is used that is symmetric and monotonic, then in a joint stationary point all state values are equal.

'More becomes more' and scale-free networks
The 'more becomes more' principle has also been used to provide an explanation for the empirical evidence that most real-world networks are scale-free. The idea is that the typical distribution of degrees according to a power law emerges from an evolving network when it is assumed that the network dynamics is based on some form of a 'more become more' principle (also called preferential attachment); see, for example, [30,[33][34][35]; see also [36,37]. An indication of the type of argument followed is illustrated in Fig. 7. Here the distribution of nodes (vertical axis) over degrees (horizontal axis) is depicted; this distribution is assumed stable over time. A time point t is considered and the focus is at the nodes with some degree d t at t (see at the horizontal axis). There is a (relative) number or density n t of them (vertical axis). Moreover, the nodes with degree between d t and a bit higher d t + d t are considered, an interval of length d t at the horizontal axis. The (relative) number of nodes with degree within this interval is represented in Fig. 7 by the area of the (left) rectangle above that interval. This area is approximated by n t d t . Now consider a time step from t to t + t. Due to growth of the number of connections, the nodes with degree d t at time t will have a higher degree d t+ t at t + t, and the nodes with degree d t + d t at time t will have a higher degree d t+ t + d t+ t at t + t. Due to the 'more becomes more' principle, from d t < d t + �d t it follows that from t to t + ∆t the nodes with degree d t + d t at time t will get more new connections than the nodes with degree d t at time t. Therefore the increase in degree of these nodes with degree d t + d t at time t will be higher: The numbers of nodes previously represented at t by the left rectangle are represented at t + t by the right rectangle. Moreover, because they describe the same nodes, the areas indicated as shaded are the same: Given this equality, from �d t+�t > �d t ('more becomes more' principle) it follows that n t+�t < n t . Therefore the distribution is monotonically decreasing. By a more X i = c(X 1 , . . . , X i−1 , X i+1 , . . . , X j−1 , X j+1 , . . . , X k , X j ) ≥ c(X 1 , . . . , X i−1 , X i+1 , . . . , X j−1 , X j+1 , . . . , X k , X i ) = X j �d t+�t > �d t n t d t = n t+ t d t+ t complex argument it has been derived that based on some more precise assumptions on the formalisation of the 'more becomes more' principle, a distribution is obtained that is monotonically decreasing according to a power law; for example, see [30,[33][34][35] for more details.

Discussion
The Network-Oriented Modelling approach based on adaptive temporal-causal networks, as described here (see also [1,10]), provides a dynamic modelling approach that enables a modeller to design high-level conceptual model representations in the form of cyclic graphs (or connection matrices). These conceptual representations can be systematically transformed in an automated manner into executable numerical representations that can be used to perform simulation experiments. The modelling approach makes it easy to take into account. on the one hand. theories and findings from any domain from, for example, biological, psychological, neurological or social sciences, as such theories and findings are often formulated in terms of causal relations. This applies, among others, to mental processes based on complex brain networks, which, for example, often involve dynamics based on interrelating and adaptive cycles, but equally well it applies to the adaptive dynamics of social interactions. For a more detailed theoretical analysis on the wide applicability of the approach, see [38,39]; for example, there it is shown that any smooth (state-determined) dynamical system can be modelled by a temporal-causal network model. This enables to address complex adaptive phenomena within all kinds of integrated cognitive, affective and social processes. By using temporal-causal relations from those domains as a main vehicle and structure for network models, the obtained network models get a strong relation to the large body of empirically founded knowledge from the Neurosciences and Social Sciences. This makes them scientifically justifiable to an extent that is not attainable for black box models which lack such a relation.
In this paper, we have discussed in some detail how mathematical analysis can be used to find out some properties of the dynamics of a network model designed according to a Network-Oriented Modelling approach based on temporal-causal networks; see also [1], chapter 12, or [31]. An advantage is that such an analysis is done without performing simulations. This advantage makes that it can be used as an additional source of knowledge, independent of a specific implementation of the model. By comparing properties found by mathematical analysis and properties observed in simulation experiments a form of verification can be done. If a discrepancy is found, for example, in the sense that the mathematical analysis predicts a certain property but some simulation does not satisfy this property, this can be a reason to inspect the implementation of the model carefully (and/or check whether the mathematical analysis is correct). Having such an option can be fruitful during a development process of a model, as to acquire empirical data for validation of a model may be more difficult or may take a longer time.
Adaptive network models combining the homophily and the 'more becomes more' principle also have been studied recently, in particular in [40,41]. The methods described in the current paper can and actually have also be applied to such integrated cases. Moreover, it has been shown in [40,41] how the modelling approach can be related to empirical real-world data on evolving friendship networks.
Mental processes can also be modelled by temporal-causal networks in an adaptive manner. The parameters that can change can be modelled in the same way as states, following the approach in "Network-Oriented Modelling by temporal-causal networks" section. This can be applied, for example to the way in which connection strengths can change based on Hebbian learning. Hebbian learning [42], is based on the principle that strengthening of a connection between neurons over time may take place when both states are often active simultaneously ('neurons that fire together, wire together'). The principle itself goes back to Hebb [42], but see also, e.g. [43]. For some more details on this, see [31].