Scan for duplicate sentences

Hi Sammy,

I'm an Independent Advisor here to help you out,

You can do that with a macro:

Open up the document and press Alt + F11 simultaneously. This will open up VBE (Visual Basic Editor).

On the left hand side you should see under Project - the name of your document, If you double-click the name of your document you add the following macro:

Option Explicit

Sub Sample()

Dim MyArray() As String

Dim n As Long, i As Long

Dim Col As New Collection

Dim itm



n = 0

'~~> Get all the sentences from the word document in an array

For i = 1 To ActiveDocument.Sentences.Count

    n = n + 1

    ReDim Preserve MyArray(n)

    MyArray(n) = Trim(ActiveDocument.Sentences(i).Text)

Next



'~~> Sort the array

SortArray MyArray, 0, UBound(MyArray)



'~~> Extract Duplicates

For i = 1 To UBound(MyArray)

    If i = UBound(MyArray) Then Exit For

    If InStr(1, MyArray(i + 1), MyArray(i), vbTextCompare) Then

        On Error Resume Next

        Col.Add MyArray(i), """" & MyArray(i) & """"

        On Error GoTo 0

    End If

Next i



'~~> Highlight duplicates

For Each itm In Col

    Selection.Find.ClearFormatting

    Selection.HomeKey wdStory, wdMove

    Selection.Find.Execute itm

    Do Until Selection.Find.Found = False

        Selection.Range.HighlightColorIndex = wdPink

        Selection.Find.Execute

    Loop

Next

End Sub

'~~> Sort the array

Public Sub SortArray(vArray As Variant, i As Long, j As Long)

Dim tmp As Variant, tmpSwap As Variant

Dim ii As Long, jj As Long

ii = i: jj = j: tmp = vArray((i + j) \ 2)

While (ii <= jj)

 While (vArray(ii) < tmp And ii < j)

    ii = ii + 1

 Wend

 While (tmp < vArray(jj) And jj > i)

    jj = jj - 1

 Wend

 If (ii <= jj) Then

    tmpSwap = vArray(ii)

    vArray(ii) = vArray(jj): vArray(jj) = tmpSwap

    ii = ii + 1: jj = jj - 1

 End If

Wend

If (i < jj) Then SortArray vArray, i, jj

If (ii < j) Then SortArray vArray, ii, j

End Sub

Close the macro window you just entered this into and just below the very top menu, there is a small play button. Click that, select the macro you just made and hit run,

This will then highlight all duplicate sections of your text,

Best,

Nick

Hi Sammy,

It is really small, I've reuploaded your screenshot circling where it is :)

If that still doesn't work, you can add the Developer tab to word and manually click on the Visual Basic option:

On the File tab, go to Options > Customize Ribbon.

Under Customize the Ribbon and under Main Tabs, select the Developer check box.

After you show the tab, the Developer tab stays visible, unless you clear the check box or have to reinstall a Microsoft Office program.

Best,

Nick

On the left hand side, where you see "This Document," double-click it and a smaller window will appear.

You'll then need to copy and paste the large macro I sent earlier - it starts with "Option explicit" and ends with "End Sub"

Once you add that in, close the macro window you just entered this into and just below the very top menu, there is a small, green play button. Click that, select the macro you just made (it will most likely be the only option) and hit run,

The macro is definitely the way to go. Sorting will help.

.

But you will also have to carefully look through the results even after the macro is run. Simple things like extra spaces, especially at the end of the paragraph could "fool" the macro into thinking that the sentences are not the same.

.

Are all of your quotes single sentences? (Many of mine aren't ... ).

.

Are you sure all of your quotes are in the same format, ie where the source name is, how it is formatted etc?