33
$\begingroup$

I'm stuck on the following question:

"Regular languages are precisely those accepted by finite automata. Given this fact, show that if the language $L$ is accepted by some finite automaton, then $L^{R}$ is also accepted by some finite; $L^{R}$ consists of all words of $L$ reversed."

$\endgroup$
14
  • 1
    $\begingroup$ Well, did you try constructing an automaton that would accept $L^R$? It may help to draw an example. $\endgroup$ Commented Aug 18, 2012 at 16:25
  • $\begingroup$ Thank you for your reply. I'm not sure how to do this. I'm sure any L^R would be accepted by some language because it is constructed out of the same 'alphabet' and so will also be a regular language. I'm not sure how to go about proving it though, or how to draw an example. $\endgroup$
    – Cat
    Commented Aug 18, 2012 at 16:40
  • 3
    $\begingroup$ Welcome! For such basic questions that smack of homework assignments, we like if the question contains (significant) prior work of the questioner. You certainly have tried something you can share (which we can then use to guide you in the correct direction). If not, I suggest you recheck your definitions and heed Gilles' advice. $\endgroup$
    – Raphael
    Commented Aug 18, 2012 at 17:13
  • 4
    $\begingroup$ @Victoria "it is constructed out of the same 'alphabet' and so will also be a regular language" -- oh, nonono. $\{a^nb^ma^o \mid n,m,o \in \mathbb{N} \}$, $\{a^nb^ma^n \mid n,m \in \mathbb{N}\}$ and $\{a^nb^na^n \mid n \in \mathbb{N}\}$ are all defined over the same alphabet but fall into very different language classes. $\endgroup$
    – Raphael
    Commented Aug 18, 2012 at 17:13
  • 1
    $\begingroup$ The other question at the end of the chapter asks me to prove that no finite automaton can accept all palindromes over a given alphabet. I think that the proof for this hinges on the fact that there are an infinite number of states if we are considering all possible palindromes (no length limit), whereas the machine is a finite state machine. $\endgroup$
    – Cat
    Commented Aug 18, 2012 at 20:07

4 Answers 4

40
$\begingroup$

So given a regular language $L$, we know (essentially by definition) that it is accepted by some finite automaton, so there's a finite set of states with appropriate transitions that take us from the starting state to the accepting state if and only if the input is a string in $L$. We can even insist that there's only one accepting state, to simplify things. Then, to accept the reverse language, all we need to do is reverse the direction of the transitions, change the start state to an accept state, and the accept state to the start state. Then we have a machine that is "backwards" compared to the original, and accepts the language $L^{R}$.

$\endgroup$
4
  • $\begingroup$ Thank you so much Luke - I think I understand what you've said. You're spot on - I have absolutely no practical experience with finite automata! I'd 'up vote' you but I don't have enough points, apparently. Sorry about that! $\endgroup$
    – Cat
    Commented Aug 19, 2012 at 15:01
  • $\begingroup$ That's fine, you should be able to "accept" answers you like (there should be a tick mark below the vote buttons). Also Saadtaame's more formal answer is an excellent next step after mine. $\endgroup$ Commented Aug 20, 2012 at 0:36
  • 7
    $\begingroup$ To assume there is only one accepting state we either must allow $\epsilon$-transitions, or have $\epsilon\notin L$. Both are not real restrictions, I know, so the answer is OK. $\endgroup$ Commented Jan 2, 2013 at 0:46
  • 1
    $\begingroup$ Yeah, the idea seems obvious to me. The tricky part is verifying that it is right. $\endgroup$
    – Nobody
    Commented Dec 16, 2017 at 15:31
39
$\begingroup$

You have to show that you can always construct a finite automaton that accepts strings in $L^R$ given a finite automaton that accepts strings in $L$. Here is a procedure to do that.

  1. Reverse all the links in the automaton
  2. Add a new state (call it $q_s$)
  3. Draw a link labeled with $\epsilon$ from state $q_s$ to every final state
  4. Turn all the final states into normal states
  5. Turn the initial state into a final state
  6. Make $q_s$ the initial state

Let's formalize all of this; we start by stating the theorem.

Theorem. If $L$ is a regular language, then so is $L^{R}$.

Let $A = (Q_A, \Sigma_A, \delta_A, q_A, F_A)$ be a NFA and let $L = L(A)$. The $\epsilon$-NFA $A^{R}$ defined below accepts the language $L^{R}$.

  1. $A^{R} = (Q_A \cup \{q_s\}, \Sigma_A, \delta_{A^R}, q_s, \{q_A\})$ and $q_s \notin Q_A$
  2. $p \in \delta_A(q, a) \iff q \in \delta_{A^R}(p, a)$, where $a \in \Sigma_A$ and $q, p \in Q_A$
  3. $\epsilon-closure(q_s) = F_A$

Proof. First, we prove the following statement: $\exists$ a path from $q$ to $p$ in $A$ labeled with $w$ if and only if $\exists$ a path from $p$ to $q$ in $A^R$ labeled with $w^R$ (the reverse of $w$) for $q, p \in Q_A$. The proof is by induction on the length of $w$.

  1. Base case: $|w| = 1$
    Holds by definition of $\delta_{A^R}$
  2. Induction: assume the statement holds for words of length $\lt n$ and let $|w| = n$ and $w = xa$
    Let $p \in \delta_A^*(q, w) = \delta_A^*(q, xa)$
    We know that $\delta_A^*(q, xa) = \cup_{p'}\delta_A(p', a)$ $\forall p' \in \delta_A^*(q, x)$
    $x$ and $a$ are words of fewer than $n$ symbols. By the induction hypothesis, $p' \in \delta_{A^R}(p, a)$ and $q \in \delta_{A^R}^*(p', x^R)$. This implies that $q \in \delta_{A^R}^*(p, ax^R) \iff p \in \delta_A^*(q, xa)$.

Letting $q = q_A$ and $p = s$ for some $s \in F_A$ and substituting $w^R$ for $ax^R$ guarantees that $q \in \delta_{A^R}^*(s, w^R)$ $\forall s \in F_A$. Since there is a path labeled with $\epsilon$ from $q_s$ to every state in $F_A$ (3. in the definition of $A^R$) and a path from every state in $F_A$ to the state $q_A$ labeled with $w^R$, then there is a path labeled with $\epsilon w^R = w^R$ from $q_s$ to $q_A$. This proves the theorem.

Notice that this proves that $(L^R)^R = L$ as well.

Please edit if there are any formatting errors or any flaws in my proof....

$\endgroup$
3
  • 2
    $\begingroup$ What do you mean by $\epsilon−closure(q_s)=FA$? $\endgroup$
    – user124384
    Commented Jan 24, 2017 at 18:33
  • $\begingroup$ But you can't have ϵ transition in deterministic regular languages can you!? $\endgroup$ Commented Jan 6, 2018 at 20:52
  • 1
    $\begingroup$ @yukashimahuksay True, but you can also always take a non-deterministic finite automaton and turn it into a deterministic finite automaton. They are equivalent. $\endgroup$
    – Pro Q
    Commented Oct 18, 2019 at 5:08
20
$\begingroup$

To add to the automata-based transformations described above, you can also prove that regular languages are closed under reversal by showing how to convert a regular expression for $L$ into a regular expression for $L^R$. To do so, we'll define a function $REV$ on regular expressions that accepts as input a regular expression $R$ for some language $L$, then produces a regular expression $R'$ for the language $L^R$. This is defined inductively on the structure of regular expressions:

  1. $REV(\epsilon) = \epsilon$
  2. $REV(\emptyset) = \emptyset$
  3. $REV(a) = a$ for any $a \in \Sigma$
  4. $REV(R_1 R_2) = REV(R_2) REV(R_1)$
  5. $REV(R_1 | R_2) = REV(R_1) | REV(R_2)$
  6. $REV(R*) = REV(R)*$
  7. $REV((R)) = (REV(R))$

You can formally prove this construction correct as an exercise.

Hope this helps!

$\endgroup$
2
  • $\begingroup$ Hi! I landed here because I was thinking about the idea of reversed regular expressions, as a way of optimizing a right-anchored match against a string: feed the characters to the reverse automaton, in reverse order. One pass. I wrote down the algebraic properties of regex reversal, and it matches your table almost exactly, even using the rev() notation. :) I also put down REV(R1&R2) = REV(R1)&REV(R2); I have a regex implementation which has intersection. Yes; I'm thinking of adding an operator for reversal perhaps R\r (reverse preceding regex element). $\endgroup$
    – Kaz
    Commented Jun 23, 2017 at 1:05
  • $\begingroup$ Here is a tricky one: what is the algebraic rule for REV(~R): regex negation? REV(~R) is the reverse of the set of all strings outside of R. Is that the same as ~REV(R): the set of all strings outside of the reverse of the set denoted by R? This is not clear at all because any palindromes in R are also in REV(R). $\endgroup$
    – Kaz
    Commented Jun 23, 2017 at 1:12
2
$\begingroup$

Using regular expressions, prove that if $L$ is a regular language then the \emph{reversal} of $L$, $L^R=\{w^R: w\in L\}$, is also regular. In particular, given a regular expression that describes $L$, show by induction how to convert it into a regular expression that describes $L^R$. Your proof should not make recourse to NFAs.

We will assume that we are given a regular expression that describes $L$. Let us first look at the concatination operator ($\circ$), and then we can move onto more advanced operators. So our cases of concatenation deal with the length of what is being concatenated. So first we will break all concatenations from $ab$ to $a\circ b$. When dealing with these break the components up as much as possible: $(ab \cup a)b \rightarrow (ab \cup a) \circ b$, but you cannot break associative order between different comprehensions of course.

When $\emptyset^R \rightarrow \emptyset$

When $s = \epsilon$, we have the empty string which is already reversed thus the mechanism does not change

When $s$ is just a letter, as in $s \in \Sigma$, the reversal is just that letter, $s$

When $s = \sigma$, we have a single constituent so we just reverse that constituent and thus $\sigma^R$

When $s = (\sigma_0\sigma_1...\sigma_{k-1}\sigma_k)$ where k is odd, we have a regular expression which can be written as $(\sigma_0\circ\sigma_1...\sigma_{k-1}\circ\sigma_k)$. The reversal of these even length strings is simple. Merely switch the 0 index with the k index. Then Switch the 1 index with k-1 index. Continue till the each element was switched once. Thus the last element is now the first in the reg ex, and the first is the last. The second to last is the second and the second is the second to last. Thus we have a reversed reg ex which will accept the reversed string (first letter is the last etc.) And of course we reverse each constituent. Thus we would get $(\sigma_k^R\sigma_{k-1}^R...\sigma_{1}^R\sigma_0^R)$

When $s = (\sigma_0\sigma_1...\sigma_{k/2}...\sigma_{k-1}\sigma_k)$ where k is even, we have a regular expression generally which can be written as $(\sigma_0\circ\sigma_1...\sigma_{k-1}\circ\sigma_k)$. The reversal of these even length strings is simple. Merely switch the 0 index with the k index. Then Switch the 1 index with k-1 index. Continue till the each element was switched once, but the k/2 element (an integer because k is even). Thus the last element is now the first in the reg ex, and the first is the last. The second to last is the second and the second is the second to last. Thus we have a reversed reg ex which will accept the reversed string (first letter is the last etc.). And that middle letter. And of course we reverse each constituent. Thus we would get $(\sigma_k^R\sigma_{k-1}^R...\sigma_{k/2}^R...\sigma_{1}^R\sigma_0^R)$

Okay the hard part is done. Let us look to the $\cup$ operator. This is merely a union of sets. So given two strings, $s_1, s_2$, the reverse of $s_1 \cup s_2$ is only $s_1^R \cup s_2^R$. The union will not change. And this makes sense. This will only add strings to a set. It does not matter which order they are added to the set, all that matters is that they are.

The kleene star operator is the same. It is merely adding strings to a set, not telling us how we should construt the string persay. So to reverse a kleene star of a string $s$, is only $((s^R)^*)$. Reversal can just move through them.

Thus to reverse this $(((a\cup b) \circ (a))^* \cup ((a\cup b) \circ (b))^*)^R$ we simply follow the rules. To reverse the outer union we simply reverse its two components. To reverse this: $((a\cup b) \circ (a))^*$ kleene star, we simply reverse what is inside it $\rightarrow (((a\cup b) \circ (a))^R)^*$. Then to reverse a concatenation, we index and then switch greatest with least. So we start with $((a\cup b) \circ (a))^R$ and get $((a)^R \circ (a\cup b)^R)$. To reverse that single letter, we reach our base case and get $(a)^R \rightarrow (a)$. This process outlined above describes an inductive description of this change.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.